Sep 16 14:33:16.642923 ip-10-0-136-124 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 14:33:16.643062 ip-10-0-136-124 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 14:33:16.643158 ip-10-0-136-124 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 14:33:16.643690 ip-10-0-136-124 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 14:33:26.892325 ip-10-0-136-124 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 14:33:26.892342 ip-10-0-136-124 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1162a11b3e044d36ab9124a55df68ada --
Sep 16 14:35:04.773228 ip-10-0-136-124 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 14:35:05.199577 ip-10-0-136-124 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:05.199577 ip-10-0-136-124 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 14:35:05.199577 ip-10-0-136-124 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:05.199577 ip-10-0-136-124 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 14:35:05.200137 ip-10-0-136-124 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 14:35:05.200532 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.200469    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 14:35:05.207758 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207739    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.207758 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207756    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.207758 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207759    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.207758 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207763    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207766    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207769    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207772    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207775    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207778    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207780    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207783    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207786    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207788    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207791    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207794    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207796    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207799    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207801    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207804    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207808    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207812    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207814    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207817    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.207900 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207820    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207823    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207825    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207828    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207831    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207833    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207836    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207839    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207842    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207845    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207847    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207850    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207852    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207856    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207858    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207861    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207864    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207867    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207870    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.208381 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207874    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207877    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207879    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207882    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207885    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207887    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207890    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207892    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207896    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207898    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207901    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207904    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207907    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207909    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207912    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207914    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207917    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207919    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207922    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207924    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.208844 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207927    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207931    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207950    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207954    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207958    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207961    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207964    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207967    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207970    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207972    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207975    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207977    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207980    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207982    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207985    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207987    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207990    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207992    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207995    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.209338 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207997    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.207999    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208003    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208005    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208008    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208010    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208012    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208015    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208017    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208020    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208022    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208024    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208027    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208029    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208032    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208034    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208036    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208039    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208714    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208721    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.209785 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208724    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208727    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208730    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208733    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208738    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208741    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208744    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208747    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208751    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208754    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208757    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208761    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208764    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208767    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208770    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208774    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208776    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208779    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208781    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.210304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208784    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208786    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208790    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208792    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208797    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208800    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208802    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208805    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208807    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208810    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208813    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208816    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208818    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208821    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208823    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208826    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208828    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208831    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208841    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.210768 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208845    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208847    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208850    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208853    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208856    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208858    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208861    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208863    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208866    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208868    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208871    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208874    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208877    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208879    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208881    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208884    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208886    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208889    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208891    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208894    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.211242 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208896    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208899    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208901    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208903    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208907    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208910    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208912    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208914    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208917    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208919    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208922    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208924    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208927    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208929    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208932    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208934    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208949    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208952    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208954    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208957    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.211720 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208959    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208962    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208965    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208968    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208970    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208973    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208975    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208978    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208980    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208983    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208985    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208988    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208990    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208993    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208995    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.208998    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209000    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209003    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209006    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209345    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.212203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209350    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209353    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209356    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209358    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209361    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209364    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209366    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209369    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209372    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209374    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209377    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209380    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209382    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209385    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209387    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209391    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209395    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209398    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209400    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.212675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209403    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209406    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209409    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209411    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209414    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209416    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209419    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209422    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209424    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209427    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209430    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209432    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209435    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209437    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209440    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209442    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209445    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209448    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209456    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.213155 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209459    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209462    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209464    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209467    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209469    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209472    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209474    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209476    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209479    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209481    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209484    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209486    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209490    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209494    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209496    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209499    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209502    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209504    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209507    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209510    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.213601 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209512    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209516    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209519    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209521    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209524    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209526    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209529    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209531    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209534    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209536    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209539    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209541    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209544    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209547    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209549    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209552    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209554    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209556    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209559    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209562    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.214080 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209564    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209566    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209569    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209572    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209574    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209577    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209580    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209582    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209585    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209587    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209590    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209592    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209597    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209599    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209602    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209604    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209606    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209609    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209611    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.209614    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.214546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209685    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209726    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209734    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209738    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209742    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209746    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209750    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209754    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209757    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209760    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209763    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209766    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209769    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209772    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209775    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209777    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209781    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209784    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209789    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209792    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209795    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209798    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209801    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209805    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 14:35:05.215067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209810    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209813    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209817    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209819    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209822    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209825    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209828    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209831    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209834    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209837    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209840    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209843    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209845    2565 flags.go:64] FLAG: --enable-server="true"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209848    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209853    2565 flags.go:64] FLAG: --event-burst="100"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209856    2565 flags.go:64] FLAG: --event-qps="50"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209858    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209861    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209864    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209867    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209870    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209873    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209876    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209879    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209882    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 14:35:05.215623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209885    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209888    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209890    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209893    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209896    2565 flags.go:64] FLAG: --feature-gates=""
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209899    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209902    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209907    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209910    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209912    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209915    2565 flags.go:64] FLAG: --help="false"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209918    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209921    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209924    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209926    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209929    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209933    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209947    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209950    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209953    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209956    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209959    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209962    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209964    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 16 14:35:05.216238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209967    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209970    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209972    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209975    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209978    2565 flags.go:64] FLAG: --lock-file=""
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209981    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209984    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209987    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209992    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209995    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.209998    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210000    2565 flags.go:64] FLAG: --logging-format="text"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210003    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210006    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210009    2565 flags.go:64] FLAG: --manifest-url=""
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210013    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210017    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210020    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210024    2565 flags.go:64] FLAG: --max-pods="110"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210027    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210030    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210033    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210035    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210038    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210041    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 14:35:05.216842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210044    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210060    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210063    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210066    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210069    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210071    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210076    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210079    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210083    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210086    2565 flags.go:64] FLAG: --port="10250"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210089    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210092    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fd97c01a0baf270d"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210095    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210098    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210101    2565 flags.go:64] FLAG: --register-node="true"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210103    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210107    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210110    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210113    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210116    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210119    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210122    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210126    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210129    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210132    2565 flags.go:64] FLAG: --runonce="false"
Sep 16 14:35:05.217528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210134    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210137    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210140    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210143    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210145    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210148    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210151    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210154    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210157    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210160    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210163    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210165    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210168    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210171    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210174    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210181    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210184    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210187    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210191    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210194    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210196    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210199    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210202    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210205    2565 flags.go:64] FLAG: --v="2"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210209    2565 flags.go:64] FLAG: --version="false"
Sep 16 14:35:05.218172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210213    2565 flags.go:64] FLAG: --vmodule=""
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210216    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.210220    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210326    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210332    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210336    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210339    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210342    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210345    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210349    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210351    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210354    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210357    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210360    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210362    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210365    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210368    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210370    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210373    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.218760 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210375    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210378    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210381    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210385    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210387    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210390    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210393    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210395    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210398    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210400    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210403    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210406    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210408    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210411    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210414    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210416    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210419    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210423    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210425    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210428    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.219243 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210430    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210433    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210436    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210440    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210443    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210446    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210449    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210452    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210455    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210458    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210460    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210463    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210465    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210468    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210470    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210474    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210477    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210479    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210482    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210485    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.219728 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210487    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210490    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210492    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210495    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210498    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210500    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210502    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210507    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210510    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210514    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210517    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210519    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210522    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210525    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210527    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210530    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210532    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210534    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210537    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210540    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.220222 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210542    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210545    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210547    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210550    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210552    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210555    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210558    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210561    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210564    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210566    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210569    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210571    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210574    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210577    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210579    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210582    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210584    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210587    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210589    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210592    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.220699 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210603    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210607    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.210609    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.211232    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.218233    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.218249    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.218261    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.218267    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218323    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218328    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218332    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218335    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218338    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218341    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218344    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.221193 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218346    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218349    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218351    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218354    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218357    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218359    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218362    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218365    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218367    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218371    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218375    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218378    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218381    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218383    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218386    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218389    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218391    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218394    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218397    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.221594 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218399    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218402    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218405    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218409    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218411    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218414    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218417    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218419    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218422    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218424    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218427    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218430    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218432    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218435    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218437    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218440    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218443    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218447    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218450    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218453    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.222085 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218456    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218459    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218462    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218464    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218467    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218469    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218472    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218474    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218477    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218479    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218482    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218485    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218488    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218490    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218493    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218495    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218498    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218501    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218504    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218507    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.222567 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218509    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218512    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218514    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218518    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218521    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218524    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218526    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218529    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218531    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218533    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218536    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218538    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218542    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218544    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218547    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218550    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218552    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218555    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218558    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.223215 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218560    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218563    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218565    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218568    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218571    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218573    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218576    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218578    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218581    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218584    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218591    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218593    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218596    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218598    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.218604    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:05.223668 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218725    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218729    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218732    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218735    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218738    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218740    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218743    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218746    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218749    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218751    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218754    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218757    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218759    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218762    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218764    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218767    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218770    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218772    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218775    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218777    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 14:35:05.224083 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218780    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218784    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218787    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218790    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218793    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218795    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218798    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218800    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218803    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218806    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218808    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218810    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218813    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218815    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218819    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218822    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218825    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218827    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218830    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 14:35:05.224546 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218832    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218834    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218837    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218839    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218842    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218844    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218847    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218849    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218852    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218854    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218857    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218859    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218862    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218864    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218867    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218869    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218872    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218875    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218877    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218879    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 14:35:05.225093 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218882    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218884    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218887    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218890    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218892    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218895    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218897    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218900    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218902    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218905    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218907    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218910    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218912    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218914    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218917    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218919    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218922    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218924    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218927    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 14:35:05.225569 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218929    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218932    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218934    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218951    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218953    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218956    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218959    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218961    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218964    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218966    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218969    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218971    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218974    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218976    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218979    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218982    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218986    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218989    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218992    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 14:35:05.226168 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218994    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:05.218997    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.219002    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.219120    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.221485    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.222591    2565 server.go:1019] "Starting client certificate rotation"
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.222714    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.222756    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 14:35:05.226917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.225389    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:35:05.229817 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.229800    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 14:35:05.241490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.241475    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 16 14:35:05.247355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.247341    2565 log.go:25] "Validated CRI v1 image API"
Sep 16 14:35:05.248163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.248150    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 14:35:05.250626 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.250606    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 91cfb2fd-a53b-4bd8-8630-53a643bd12ae:/dev/nvme0n1p4 a46680cf-5285-4a6d-b637-d0cd13b2c4d4:/dev/nvme0n1p3]
Sep 16 14:35:05.250687 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.250624    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 14:35:05.255537 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.255441    2565 manager.go:216] Machine: {Timestamp:2026-09-16 14:35:05.254033783 +0000 UTC m=+0.355509226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199708 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221fe8c0d68d7794eff611f1cac52e SystemUUID:ec221fe8-c0d6-8d77-94ef-f611f1cac52e BootID:1162a11b-3e04-4d36-ab91-24a55df68ada Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f9:8d:bf:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f9:8d:bf:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:a2:de:27:10:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 14:35:05.255537 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.255533    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 14:35:05.255636 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.255597    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 14:35:05.259269 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.259244    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 14:35:05.259398 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.259271    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-124.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 14:35:05.260180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.260170    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 14:35:05.260212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.260182    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 14:35:05.260212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.260193    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:35:05.261032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.261021    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 14:35:05.262295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.262286    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 14:35:05.266928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.266917    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:35:05.267068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267057    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 14:35:05.267112 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267103    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 14:35:05.267145 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267127    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 14:35:05.267171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267145    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 14:35:05.267171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267163    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 16 14:35:05.267226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267181    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 14:35:05.267503 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267489    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:35:05.267543 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.267510    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 14:35:05.269789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.269772    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 14:35:05.270559 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.270542    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:35:05.272828 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.272812    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 14:35:05.272908 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.272855    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 14:35:05.274815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274801    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274821    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274829    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274836    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274849    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274857    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274876    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 14:35:05.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274885    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 14:35:05.275124 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274895    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 14:35:05.275124 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274905    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 14:35:05.275124 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274917    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 14:35:05.275124 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.274925    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 14:35:05.276777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.276765    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 14:35:05.276850 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.276781    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 14:35:05.281013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.280995    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-124.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 14:35:05.281407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.281392    2565 server.go:1268] "Started kubelet"
Sep 16 14:35:05.281517 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.281496    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 14:35:05.281576 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.281494    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 14:35:05.281576 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.281474    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 14:35:05.281576 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.281532    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 14:35:05.281709 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.281598    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 14:35:05.282243 ip-10-0-136-124 systemd[1]: Started Kubernetes Kubelet.
Sep 16 14:35:05.282833 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.282713    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 14:35:05.283127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.283112    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 14:35:05.287223 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.287206    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 14:35:05.290754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.290738    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 14:35:05.290754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.290746    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 14:35:05.290889 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.290875    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.290981 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.289785    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd363cfcb7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.281363127 +0000 UTC m=+0.382838571,LastTimestamp:2026-09-16 14:35:05.281363127 +0000 UTC m=+0.382838571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.291614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291599    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 14:35:05.291695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291647    2565 factory.go:55] Registering systemd factory
Sep 16 14:35:05.291695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291659    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 16 14:35:05.291695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291615    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 14:35:05.291695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291683    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 14:35:05.291695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291603    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 14:35:05.291902 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291737    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 14:35:05.291902 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291748    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 14:35:05.291902 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291879    2565 factory.go:153] Registering CRI-O factory
Sep 16 14:35:05.291902 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291892    2565 factory.go:223] Registration of the crio container factory successfully
Sep 16 14:35:05.292081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291907    2565 factory.go:103] Registering Raw factory
Sep 16 14:35:05.292081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.291919    2565 manager.go:1196] Started watching for new ooms in manager
Sep 16 14:35:05.293985 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.293963    2565 manager.go:349] Starting recovery of all containers
Sep 16 14:35:05.296825 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.296797    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-124.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 14:35:05.296933 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.296913    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 14:35:05.303227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.303206    2565 manager.go:354] Recovery completed
Sep 16 14:35:05.305393 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.305372    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 16 14:35:05.308527 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.308515    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.310308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310290    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.310371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310320    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.310371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310334    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.310810 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310797    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 14:35:05.310810 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310805    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.310810 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310809    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 14:35:05.310929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.310823    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 14:35:05.311477 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.311462    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.311526 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.311490    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.311526 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.311503    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.313134 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.313049    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f6a178  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.31030668 +0000 UTC m=+0.411782127,LastTimestamp:2026-09-16 14:35:05.31030668 +0000 UTC m=+0.411782127,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.313215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.313174    2565 policy_none.go:49] "None policy: Start"
Sep 16 14:35:05.313215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.313191    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 14:35:05.313215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.313204    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 14:35:05.315213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.315198    2565 policy_none.go:47] "Start"
Sep 16 14:35:05.325184 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.325095    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f6f212  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.310327314 +0000 UTC m=+0.411802760,LastTimestamp:2026-09-16 14:35:05.310327314 +0000 UTC m=+0.411802760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.336455 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.336393    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f719bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.310337471 +0000 UTC m=+0.411812914,LastTimestamp:2026-09-16 14:35:05.310337471 +0000 UTC m=+0.411812914,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.349033 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.348969    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-124.ec2.internal.18d5d3cd37f6a178\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f6a178  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.31030668 +0000 UTC m=+0.411782127,LastTimestamp:2026-09-16 14:35:05.311476842 +0000 UTC m=+0.412952287,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.354451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354438    2565 manager.go:337] "Starting Device Plugin manager"
Sep 16 14:35:05.354507 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.354467    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 14:35:05.354507 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354477    2565 server.go:87] "Starting device plugin registration server"
Sep 16 14:35:05.354774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354761    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 14:35:05.354876 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354773    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 14:35:05.354927 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354883    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 14:35:05.354987 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354967    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 14:35:05.354987 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.354976    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 14:35:05.355420 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.355400    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 14:35:05.355494 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.355445    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.364596 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.364529    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-124.ec2.internal.18d5d3cd37f6f212\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f6f212  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.310327314 +0000 UTC m=+0.411802760,LastTimestamp:2026-09-16 14:35:05.311496301 +0000 UTC m=+0.412971746,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.367952 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.367918    2565 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2595 into the system container \"/system.slice\": <nil>"
Sep 16 14:35:05.372125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.372109    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnf55"
Sep 16 14:35:05.376015 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.375962    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-124.ec2.internal.18d5d3cd37f719bf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd37f719bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-124.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.310337471 +0000 UTC m=+0.411812914,LastTimestamp:2026-09-16 14:35:05.311508565 +0000 UTC m=+0.412984009,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.382121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.382106    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bnf55"
Sep 16 14:35:05.384751 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.384701    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-124.ec2.internal.18d5d3cd3b1f69c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-124.ec2.internal,UID:ip-10-0-136-124.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-124.ec2.internal,},FirstTimestamp:2026-09-16 14:35:05.363311044 +0000 UTC m=+0.464786479,LastTimestamp:2026-09-16 14:35:05.363311044 +0000 UTC m=+0.464786479,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-124.ec2.internal,}"
Sep 16 14:35:05.455033 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.454975    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.455669 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.455650    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.455727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.455679    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.455727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.455695    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.455727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.455723    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.475959 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.475928    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.475965    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-124.ec2.internal\": node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.479494    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.480592    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.480632    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.480651    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.480686    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 14:35:05.486880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.485206    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:05.535827 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.535807    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.581224 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.581204    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"]
Sep 16 14:35:05.581280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.581271    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.582786 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.582771    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.582837 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.582799    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.582837 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.582810    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.585054 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585041    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.585157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.585196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585170    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.585695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585670    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.585695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585680    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.585695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585697    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.585884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585702    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.585884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585712    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.585884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.585715    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.587974 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.587958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.588053 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.587986    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:05.588699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.588685    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:05.588699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.588710    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:05.588816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.588726    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:05.593216 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.593197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.593298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.593222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d462eff659027c761e729fec4016c1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-124.ec2.internal\" (UID: \"00d462eff659027c761e729fec4016c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.593298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.593239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.603464 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.603445    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-124.ec2.internal\" not found" node="ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.607595 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.607577    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-124.ec2.internal\" not found" node="ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.636819 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.636801    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.693821 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d462eff659027c761e729fec4016c1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-124.ec2.internal\" (UID: \"00d462eff659027c761e729fec4016c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.693889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.693929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.693929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.694009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693946    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/feac09e4f283d3fc47947fc9e60141d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal\" (UID: \"feac09e4f283d3fc47947fc9e60141d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.694009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.693916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00d462eff659027c761e729fec4016c1-config\") pod \"kube-apiserver-proxy-ip-10-0-136-124.ec2.internal\" (UID: \"00d462eff659027c761e729fec4016c1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.737763 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.737721    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.838797 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.838774    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:05.907254 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.907220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.911357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:05.911336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:05.939722 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:05.939690    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.040215 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.040163    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.140652 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.140632    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.222081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.222060    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 14:35:06.222479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.222229    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 14:35:06.241520 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.241499    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.342979 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.342914    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.388476 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.388427    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 14:30:05 +0000 UTC" deadline="2028-05-03 22:20:39.960340534 +0000 UTC"
Sep 16 14:35:06.388476 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.388471    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14287h45m33.57187308s"
Sep 16 14:35:06.441754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.441730    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 14:35:06.442738 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.442723    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 14:35:06.442836 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.442754    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 14:35:06.442836 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.442774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeHasSufficientPID"
Sep 16 14:35:06.443039 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.443024    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.530506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.530489    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:06.543195 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.543172    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.646560 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:06.646495    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-124.ec2.internal\" not found"
Sep 16 14:35:06.687950 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:06.687897    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeac09e4f283d3fc47947fc9e60141d8.slice/crio-28aa53b4b3f90d3d8449eeda78048216332d6fecf69cb6794680810f827a1de0 WatchSource:0}: Error finding container 28aa53b4b3f90d3d8449eeda78048216332d6fecf69cb6794680810f827a1de0: Status 404 returned error can't find the container with id 28aa53b4b3f90d3d8449eeda78048216332d6fecf69cb6794680810f827a1de0
Sep 16 14:35:06.688178 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:06.688156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d462eff659027c761e729fec4016c1.slice/crio-5e820f89cfd9cb7e606a490733b19b5d44c2f82289dd37c6ab1dd415cee8ef1f WatchSource:0}: Error finding container 5e820f89cfd9cb7e606a490733b19b5d44c2f82289dd37c6ab1dd415cee8ef1f: Status 404 returned error can't find the container with id 5e820f89cfd9cb7e606a490733b19b5d44c2f82289dd37c6ab1dd415cee8ef1f
Sep 16 14:35:06.692749 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.692732    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:35:06.714433 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.714410    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:06.791743 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.791676    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:06.810867 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.810847    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:35:06.812757 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.812741    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal"
Sep 16 14:35:06.817027 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.817005    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:06.825532 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:06.825514    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 14:35:07.097953 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.097879    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 14:35:07.269095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.269072    2565 apiserver.go:52] "Watching apiserver"
Sep 16 14:35:07.279490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.279469    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 14:35:07.280818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.280792    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv","openshift-dns/node-resolver-t8x6z","openshift-network-diagnostics/network-check-target-pp25f","openshift-network-operator/iptables-alerter-wjsz6","openshift-ovn-kubernetes/ovnkube-node-kpt4r","kube-system/konnectivity-agent-6b8lf","kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal","openshift-cluster-node-tuning-operator/tuned-trhl9","openshift-image-registry/node-ca-s2vwg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal","openshift-multus/multus-additional-cni-plugins-6r2cz","openshift-multus/multus-mcnmb","openshift-multus/network-metrics-daemon-bqtp9","kube-system/global-pull-secret-syncer-tkv5q"]
Sep 16 14:35:07.283513 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.283485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.285918 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.285878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.287166 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.287142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.287454 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.287143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.287767 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.287741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nq28b\""
Sep 16 14:35:07.288371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.288353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.291023 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.290995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.292206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.292185    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 14:35:07.293368 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.293342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.294187 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.294164    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.294310 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.294288    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 14:35:07.294405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.294383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpn8q\""
Sep 16 14:35:07.294519 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.294499    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.294586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.294566    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.296150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.296130    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.296243 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.296207    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:07.299940 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.299406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:07.299940 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.299489    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:07.301248 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.301227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.302089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.302163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bpld\" (UniqueName: \"kubernetes.io/projected/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-kube-api-access-6bpld\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-host\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dcc4de-7619-4c93-abf9-2e2e771c3c27-host\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-socket-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvqf7\" (UniqueName: \"kubernetes.io/projected/98d78855-378a-4dcd-94d4-db61c55e237e-kube-api-access-lvqf7\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-kubernetes\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-run\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-tuned\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-tmp\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.303996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tssc9\" (UniqueName: \"kubernetes.io/projected/74dcc4de-7619-4c93-abf9-2e2e771c3c27-kube-api-access-tssc9\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-hosts-file\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-device-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-conf\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-94nwr\""
Sep 16 14:35:07.305415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-lib-modules\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-var-lib-kubelet\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d068fed-3879-4a99-9a62-28438fa7f700-iptables-alerter-script\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7psn\" (UniqueName: \"kubernetes.io/projected/6d068fed-3879-4a99-9a62-28438fa7f700-kube-api-access-r7psn\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysconfig\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqc2m\" (UniqueName: \"kubernetes.io/projected/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-kube-api-access-lqc2m\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-systemd\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d068fed-3879-4a99-9a62-28438fa7f700-host-slash\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-modprobe-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-sys\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304461    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dcc4de-7619-4c93-abf9-2e2e771c3c27-serviceca\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-registration-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-sys-fs\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-tmp-dir\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.304600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-etc-selinux\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.306406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.305131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-swlm9\""
Sep 16 14:35:07.307243 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 14:35:07.307243 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307209    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.307483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307452    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.307585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307512    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.307651 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307598    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lzrlt\""
Sep 16 14:35:07.307844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.307817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.309817 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.309584    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 14:35:07.309927 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.309659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.309927 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.309871    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 14:35:07.310694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.310670    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.310783 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.310719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vz2m7\""
Sep 16 14:35:07.310959 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.310941    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 14:35:07.311055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.310989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.311117 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.311057    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:07.311215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.311193    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 14:35:07.313858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.313838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.314766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.314747    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qzb5x\""
Sep 16 14:35:07.314969 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.314937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 14:35:07.315089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.315079    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 14:35:07.316481 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.316461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.323413 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.323395    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 14:35:07.323571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.323547    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 14:35:07.323644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.323486    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 14:35:07.323753 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.323437    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 14:35:07.324095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.324075    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 14:35:07.324196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.324080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wfwkk\""
Sep 16 14:35:07.327004 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.326984    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 14:35:07.327226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.327207    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8jjlz\""
Sep 16 14:35:07.344742 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.344720    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 14:35:07.360477 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.360451    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-84j5m"
Sep 16 14:35:07.381242 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.381220    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-84j5m"
Sep 16 14:35:07.392907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.392888    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 14:35:07.405379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-modprobe-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.405478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.405478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-bin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdk7h\" (UniqueName: \"kubernetes.io/projected/e2886a41-3797-4d87-9519-98f78ae92f15-kube-api-access-zdk7h\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-netns\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-bin\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-tmp-dir\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-modprobe-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.405591 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-etc-selinux\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bpld\" (UniqueName: \"kubernetes.io/projected/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-kube-api-access-6bpld\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-script-lib\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-etc-selinux\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-host\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.405805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-host\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.406083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.406083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.405978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-cnibin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.406083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-kubelet\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.406083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-hostroot\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwm84\" (UniqueName: \"kubernetes.io/projected/73cd2c64-6381-4d12-b554-b56ad3035037-kube-api-access-hwm84\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-socket-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvqf7\" (UniqueName: \"kubernetes.io/projected/98d78855-378a-4dcd-94d4-db61c55e237e-kube-api-access-lvqf7\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406225    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-tuned\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-socket-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-systemd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.406381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-config\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-dbus\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-multus-certs\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-hosts-file\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-conf\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-var-lib-kubelet\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406638    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-binary-copy\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-log-socket\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-multus-daemon-config\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.406745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7psn\" (UniqueName: \"kubernetes.io/projected/6d068fed-3879-4a99-9a62-28438fa7f700-kube-api-access-r7psn\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-system-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-socket-dir-parent\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-k8s-cni-cncf-io\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-systemd-units\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-slash\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-tmp-dir\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.406977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqc2m\" (UniqueName: \"kubernetes.io/projected/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-kube-api-access-lqc2m\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-netns\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-etc-kubernetes\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407099    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d068fed-3879-4a99-9a62-28438fa7f700-host-slash\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-sys\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dcc4de-7619-4c93-abf9-2e2e771c3c27-serviceca\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95ch\" (UniqueName: \"kubernetes.io/projected/5638d4c9-da7d-4be3-9754-640016fde5df-kube-api-access-j95ch\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-registration-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.407331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-sys-fs\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-registration-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-multus\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-hosts-file\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-var-lib-kubelet\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-kubelet-config\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-kubelet\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-sys-fs\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-var-lib-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d068fed-3879-4a99-9a62-28438fa7f700-host-slash\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-conf\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-sys\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-konnectivity-ca\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408105 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dcc4de-7619-4c93-abf9-2e2e771c3c27-host\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407678    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dcc4de-7619-4c93-abf9-2e2e771c3c27-host\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysctl-d\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-ovn\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-netd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovn-node-metrics-cert\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q486\" (UniqueName: \"kubernetes.io/projected/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-kube-api-access-2q486\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-kubernetes\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-run\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-tmp\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dcc4de-7619-4c93-abf9-2e2e771c3c27-serviceca\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tssc9\" (UniqueName: \"kubernetes.io/projected/74dcc4de-7619-4c93-abf9-2e2e771c3c27-kube-api-access-tssc9\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.407966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-run\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-kubernetes\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-cni-binary-copy\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-env-overrides\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.408971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-device-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-lib-modules\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-system-cni-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-conf-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98d78855-378a-4dcd-94d4-db61c55e237e-device-dir\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-etc-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-node-log\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d068fed-3879-4a99-9a62-28438fa7f700-iptables-alerter-script\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysconfig\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-lib-modules\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-agent-certs\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-systemd\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-cnibin\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-systemd\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-sysconfig\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.409814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.408978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d068fed-3879-4a99-9a62-28438fa7f700-iptables-alerter-script\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.412606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.412587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-etc-tuned\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.412713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.412690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-tmp\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.426797 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.426726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7psn\" (UniqueName: \"kubernetes.io/projected/6d068fed-3879-4a99-9a62-28438fa7f700-kube-api-access-r7psn\") pod \"iptables-alerter-wjsz6\" (UID: \"6d068fed-3879-4a99-9a62-28438fa7f700\") " pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.426797 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.426763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqc2m\" (UniqueName: \"kubernetes.io/projected/98b0e16d-aeef-4155-8ea8-54d4ffd3131b-kube-api-access-lqc2m\") pod \"node-resolver-t8x6z\" (UID: \"98b0e16d-aeef-4155-8ea8-54d4ffd3131b\") " pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.428405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.428368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tssc9\" (UniqueName: \"kubernetes.io/projected/74dcc4de-7619-4c93-abf9-2e2e771c3c27-kube-api-access-tssc9\") pod \"node-ca-s2vwg\" (UID: \"74dcc4de-7619-4c93-abf9-2e2e771c3c27\") " pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.428509 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.428434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bpld\" (UniqueName: \"kubernetes.io/projected/df2b1ad7-35d0-4761-8a29-c2eeb829e1ea-kube-api-access-6bpld\") pod \"tuned-trhl9\" (UID: \"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea\") " pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.429139 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.429095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvqf7\" (UniqueName: \"kubernetes.io/projected/98d78855-378a-4dcd-94d4-db61c55e237e-kube-api-access-lvqf7\") pod \"aws-ebs-csi-driver-node-j62bv\" (UID: \"98d78855-378a-4dcd-94d4-db61c55e237e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.487739 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.487666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal" event={"ID":"feac09e4f283d3fc47947fc9e60141d8","Type":"ContainerStarted","Data":"28aa53b4b3f90d3d8449eeda78048216332d6fecf69cb6794680810f827a1de0"}
Sep 16 14:35:07.491730 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.491678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal" event={"ID":"00d462eff659027c761e729fec4016c1","Type":"ContainerStarted","Data":"5e820f89cfd9cb7e606a490733b19b5d44c2f82289dd37c6ab1dd415cee8ef1f"}
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-etc-kubernetes\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95ch\" (UniqueName: \"kubernetes.io/projected/5638d4c9-da7d-4be3-9754-640016fde5df-kube-api-access-j95ch\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-multus\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-kubelet-config\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-kubelet\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-var-lib-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-konnectivity-ca\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-ovn\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-netd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-netd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-kubelet-config\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-var-lib-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-kubelet\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.510278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-etc-kubernetes\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.509981    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-multus\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510012    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovn-node-metrics-cert\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-konnectivity-ca\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-ovn\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q486\" (UniqueName: \"kubernetes.io/projected/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-kube-api-access-2q486\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-cni-binary-copy\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-env-overrides\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-system-cni-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-conf-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-etc-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-node-log\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-agent-certs\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.511215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-cnibin\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-bin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdk7h\" (UniqueName: \"kubernetes.io/projected/e2886a41-3797-4d87-9519-98f78ae92f15-kube-api-access-zdk7h\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-netns\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-bin\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-script-lib\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-cnibin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510756    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-kubelet\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-hostroot\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwm84\" (UniqueName: \"kubernetes.io/projected/73cd2c64-6381-4d12-b554-b56ad3035037-kube-api-access-hwm84\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-systemd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-config\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-dbus\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-multus-certs\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.510984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-binary-copy\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-log-socket\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-multus-daemon-config\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-system-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-socket-dir-parent\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-k8s-cni-cncf-io\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-systemd-units\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-cni-binary-copy\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-slash\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-netns\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-slash\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-cnibin\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.511411    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.511489    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:08.011468278 +0000 UTC m=+3.112943727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:07.512907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-cni-bin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.511939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-etc-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512159    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-netns\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-cni-bin\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512233    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-multus-certs\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovn-node-metrics-cert\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-node-log\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-systemd\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-cnibin\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-script-lib\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512895    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-hostroot\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-var-lib-kubelet\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-run-openvswitch\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.512968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8bf35fc1-8936-4784-a329-fe71c5357342-dbus\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:07.513789 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.513052    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.513111    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:08.013094247 +0000 UTC m=+3.114569698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-socket-dir-parent\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-log-socket\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5638d4c9-da7d-4be3-9754-640016fde5df-cni-binary-copy\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-k8s-cni-cncf-io\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-ovnkube-config\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-system-cni-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e2886a41-3797-4d87-9519-98f78ae92f15-multus-daemon-config\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5638d4c9-da7d-4be3-9754-640016fde5df-system-cni-dir\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-multus-conf-dir\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513733    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-env-overrides\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-systemd-units\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.514654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.513779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e2886a41-3797-4d87-9519-98f78ae92f15-host-run-netns\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.516939 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.516915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbcde4ed-12ca-4321-8675-2e40dfcffc6f-agent-certs\") pod \"konnectivity-agent-6b8lf\" (UID: \"fbcde4ed-12ca-4321-8675-2e40dfcffc6f\") " pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.526939 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.526812    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:07.526939 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.526838    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:07.526939 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.526852    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:07.526939 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:07.526914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:08.026891051 +0000 UTC m=+3.128366487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:07.527816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.527773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwm84\" (UniqueName: \"kubernetes.io/projected/73cd2c64-6381-4d12-b554-b56ad3035037-kube-api-access-hwm84\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:07.528729 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.528507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q486\" (UniqueName: \"kubernetes.io/projected/8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc-kube-api-access-2q486\") pod \"ovnkube-node-kpt4r\" (UID: \"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.528824 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.528798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95ch\" (UniqueName: \"kubernetes.io/projected/5638d4c9-da7d-4be3-9754-640016fde5df-kube-api-access-j95ch\") pod \"multus-additional-cni-plugins-6r2cz\" (UID: \"5638d4c9-da7d-4be3-9754-640016fde5df\") " pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.531094 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.531063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdk7h\" (UniqueName: \"kubernetes.io/projected/e2886a41-3797-4d87-9519-98f78ae92f15-kube-api-access-zdk7h\") pod \"multus-mcnmb\" (UID: \"e2886a41-3797-4d87-9519-98f78ae92f15\") " pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.595357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.595332    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t8x6z"
Sep 16 14:35:07.606421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.606037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wjsz6"
Sep 16 14:35:07.606631 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.606608    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b0e16d_aeef_4155_8ea8_54d4ffd3131b.slice/crio-7955ffad609b2671aae3a196ff44ebd1aac8757e962c77553491a6263f078aa6 WatchSource:0}: Error finding container 7955ffad609b2671aae3a196ff44ebd1aac8757e962c77553491a6263f078aa6: Status 404 returned error can't find the container with id 7955ffad609b2671aae3a196ff44ebd1aac8757e962c77553491a6263f078aa6
Sep 16 14:35:07.615982 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.615954    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d068fed_3879_4a99_9a62_28438fa7f700.slice/crio-83a4a3d860f748dc89f431da51d5c7bae86804987fbc84a94b303fae28718211 WatchSource:0}: Error finding container 83a4a3d860f748dc89f431da51d5c7bae86804987fbc84a94b303fae28718211: Status 404 returned error can't find the container with id 83a4a3d860f748dc89f431da51d5c7bae86804987fbc84a94b303fae28718211
Sep 16 14:35:07.617772 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.617587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv"
Sep 16 14:35:07.623745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.623725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trhl9"
Sep 16 14:35:07.628101 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.628079    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d78855_378a_4dcd_94d4_db61c55e237e.slice/crio-8a12767378643b9bcacddb2aca6bc4e227112f3d6489e867296768c3a8ba6fa2 WatchSource:0}: Error finding container 8a12767378643b9bcacddb2aca6bc4e227112f3d6489e867296768c3a8ba6fa2: Status 404 returned error can't find the container with id 8a12767378643b9bcacddb2aca6bc4e227112f3d6489e867296768c3a8ba6fa2
Sep 16 14:35:07.634169 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.634091    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s2vwg"
Sep 16 14:35:07.634335 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.634310    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2b1ad7_35d0_4761_8a29_c2eeb829e1ea.slice/crio-c03ef4f123847344891939652d75b7a7f182fd815e590764da5c697e26e86eaa WatchSource:0}: Error finding container c03ef4f123847344891939652d75b7a7f182fd815e590764da5c697e26e86eaa: Status 404 returned error can't find the container with id c03ef4f123847344891939652d75b7a7f182fd815e590764da5c697e26e86eaa
Sep 16 14:35:07.641352 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.641322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:07.643974 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.643952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74dcc4de_7619_4c93_abf9_2e2e771c3c27.slice/crio-06c1e30b5b41cbfcaf22145b6b19719eb324672d94145b0068ccffbc3e910c97 WatchSource:0}: Error finding container 06c1e30b5b41cbfcaf22145b6b19719eb324672d94145b0068ccffbc3e910c97: Status 404 returned error can't find the container with id 06c1e30b5b41cbfcaf22145b6b19719eb324672d94145b0068ccffbc3e910c97
Sep 16 14:35:07.650045 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.650027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:07.651682 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.651638    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8855e83e_ba71_4fa0_aa18_7a1a5d6c85cc.slice/crio-3dd2d36d9157e1125d96cd5f2b63d28f6af70d4667a9ef3c43ff9d23250cf5be WatchSource:0}: Error finding container 3dd2d36d9157e1125d96cd5f2b63d28f6af70d4667a9ef3c43ff9d23250cf5be: Status 404 returned error can't find the container with id 3dd2d36d9157e1125d96cd5f2b63d28f6af70d4667a9ef3c43ff9d23250cf5be
Sep 16 14:35:07.657378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.657358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6r2cz"
Sep 16 14:35:07.660051 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.660029    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbcde4ed_12ca_4321_8675_2e40dfcffc6f.slice/crio-96b048ac40ab52bf56f7e60559f7597ca7dd883baa9ebec58970f3226b4ae7af WatchSource:0}: Error finding container 96b048ac40ab52bf56f7e60559f7597ca7dd883baa9ebec58970f3226b4ae7af: Status 404 returned error can't find the container with id 96b048ac40ab52bf56f7e60559f7597ca7dd883baa9ebec58970f3226b4ae7af
Sep 16 14:35:07.664563 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:07.664479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcnmb"
Sep 16 14:35:07.667352 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.667328    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5638d4c9_da7d_4be3_9754_640016fde5df.slice/crio-06b254341dca939685f2affc72a7cced002aecd9686eab9583c54f91587f5cb8 WatchSource:0}: Error finding container 06b254341dca939685f2affc72a7cced002aecd9686eab9583c54f91587f5cb8: Status 404 returned error can't find the container with id 06b254341dca939685f2affc72a7cced002aecd9686eab9583c54f91587f5cb8
Sep 16 14:35:07.676059 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:07.675969    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2886a41_3797_4d87_9519_98f78ae92f15.slice/crio-741d6d1a1bc94b3213fd1f9601b374ce432b3c6f8ca1c12f68336d6ea454ebbd WatchSource:0}: Error finding container 741d6d1a1bc94b3213fd1f9601b374ce432b3c6f8ca1c12f68336d6ea454ebbd: Status 404 returned error can't find the container with id 741d6d1a1bc94b3213fd1f9601b374ce432b3c6f8ca1c12f68336d6ea454ebbd
Sep 16 14:35:08.014364 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.014294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:08.014516 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.014365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:08.014516 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.014452    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:08.014644 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.014529    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:09.014508171 +0000 UTC m=+4.115983604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:08.014644 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.014452    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:08.014644 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.014595    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:09.014582395 +0000 UTC m=+4.116057841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:08.115250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.115215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:08.115404 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.115377    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:08.115404 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.115402    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:08.115479 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.115415    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:08.115479 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.115465    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:09.115452557 +0000 UTC m=+4.216927990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:08.384514 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.384437    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:30:07 +0000 UTC" deadline="2028-03-16 04:30:56.382190496 +0000 UTC"
Sep 16 14:35:08.384514 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.384466    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13117h55m47.997728255s"
Sep 16 14:35:08.480853 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.480814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:08.480853 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.480852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:08.481109 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.480941    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:08.481109 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.480949    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:08.481109 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.481014    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:08.481109 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:08.481042    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:08.494575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.494537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcnmb" event={"ID":"e2886a41-3797-4d87-9519-98f78ae92f15","Type":"ContainerStarted","Data":"741d6d1a1bc94b3213fd1f9601b374ce432b3c6f8ca1c12f68336d6ea454ebbd"}
Sep 16 14:35:08.495571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.495546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerStarted","Data":"06b254341dca939685f2affc72a7cced002aecd9686eab9583c54f91587f5cb8"}
Sep 16 14:35:08.496616 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.496596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"3dd2d36d9157e1125d96cd5f2b63d28f6af70d4667a9ef3c43ff9d23250cf5be"}
Sep 16 14:35:08.497771 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.497750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2vwg" event={"ID":"74dcc4de-7619-4c93-abf9-2e2e771c3c27","Type":"ContainerStarted","Data":"06c1e30b5b41cbfcaf22145b6b19719eb324672d94145b0068ccffbc3e910c97"}
Sep 16 14:35:08.498814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.498788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trhl9" event={"ID":"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea","Type":"ContainerStarted","Data":"c03ef4f123847344891939652d75b7a7f182fd815e590764da5c697e26e86eaa"}
Sep 16 14:35:08.499779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.499757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjsz6" event={"ID":"6d068fed-3879-4a99-9a62-28438fa7f700","Type":"ContainerStarted","Data":"83a4a3d860f748dc89f431da51d5c7bae86804987fbc84a94b303fae28718211"}
Sep 16 14:35:08.500834 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.500815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t8x6z" event={"ID":"98b0e16d-aeef-4155-8ea8-54d4ffd3131b","Type":"ContainerStarted","Data":"7955ffad609b2671aae3a196ff44ebd1aac8757e962c77553491a6263f078aa6"}
Sep 16 14:35:08.502069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.502047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b8lf" event={"ID":"fbcde4ed-12ca-4321-8675-2e40dfcffc6f","Type":"ContainerStarted","Data":"96b048ac40ab52bf56f7e60559f7597ca7dd883baa9ebec58970f3226b4ae7af"}
Sep 16 14:35:08.503250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:08.503230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv" event={"ID":"98d78855-378a-4dcd-94d4-db61c55e237e","Type":"ContainerStarted","Data":"8a12767378643b9bcacddb2aca6bc4e227112f3d6489e867296768c3a8ba6fa2"}
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.022269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.022367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.022505    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.022563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:11.022544257 +0000 UTC m=+6.124019711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.022637    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:09.023608 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.022672    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:11.022659659 +0000 UTC m=+6.124135096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:09.123410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.123339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:09.123567 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.123550    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:09.123629 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.123579    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:09.123629 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.123594    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:09.123730 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:09.123654    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:11.123636677 +0000 UTC m=+6.225112127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:09.385280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.385168    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 14:30:07 +0000 UTC" deadline="2028-04-09 02:53:02.647115746 +0000 UTC"
Sep 16 14:35:09.385280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.385234    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13692h17m53.261888502s"
Sep 16 14:35:09.513100 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:09.513067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal" event={"ID":"00d462eff659027c761e729fec4016c1","Type":"ContainerStarted","Data":"bc99bc7d9967efad2dab08e7ebaccb806461333dbdbb2488b585dfc6dfa0dc1f"}
Sep 16 14:35:10.480970 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.480931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:10.481534 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:10.481060    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:10.481534 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.481411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:10.481534 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:10.481498    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:10.481677 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.481556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:10.481677 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:10.481635    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:10.540113 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.539026    2565 generic.go:356] "Generic (PLEG): container finished" podID="feac09e4f283d3fc47947fc9e60141d8" containerID="a860c3c8a3a4c80299e5a27309bd4f44513980c5464cab162ffaaa1d601521cc" exitCode=0
Sep 16 14:35:10.540113 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.539896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal" event={"ID":"feac09e4f283d3fc47947fc9e60141d8","Type":"ContainerDied","Data":"a860c3c8a3a4c80299e5a27309bd4f44513980c5464cab162ffaaa1d601521cc"}
Sep 16 14:35:10.571428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:10.571362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-124.ec2.internal" podStartSLOduration=3.5713424419999997 podStartE2EDuration="3.571342442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:09.537929038 +0000 UTC m=+4.639404491" watchObservedRunningTime="2026-09-16 14:35:10.571342442 +0000 UTC m=+5.672817894"
Sep 16 14:35:11.040182 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:11.040148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:11.040366 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:11.040232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:11.040366 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.040350    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:11.040477 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.040404    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:15.040387069 +0000 UTC m=+10.141862515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:11.040789 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.040765    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:11.040893 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.040817    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:15.040802331 +0000 UTC m=+10.142277771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:11.141279 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:11.141246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:11.141442 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.141425    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:11.141508 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.141449    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:11.141508 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.141461    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:11.141606 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:11.141527    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:15.141510546 +0000 UTC m=+10.242985986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:12.481830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:12.481828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:12.481932    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:12.481974    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:12.482065    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:12.482213 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:12.482135    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:14.480969 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:14.480920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:14.481405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:14.481038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:14.481405 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:14.481048    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:14.481405 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:14.481161    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:14.481405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:14.481204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:14.481405 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:14.481266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:15.072488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:15.072450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:15.072649 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:15.072513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:15.072649 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.072596    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:15.072649 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.072637    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:15.072805 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.072667    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:23.072646631 +0000 UTC m=+18.174122066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:15.072805 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.072687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:23.07267706 +0000 UTC m=+18.174152499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:15.173830 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:15.173588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:15.173830 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.173736    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:15.173830 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.173755    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:15.173830 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.173768    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:15.173830 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:15.173823    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:23.173806894 +0000 UTC m=+18.275282337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:16.481483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:16.481188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:16.481483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:16.481235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:16.481483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:16.481243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:16.481483 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:16.481316    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:16.481483 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:16.481431    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:16.482083 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:16.481525    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:18.481390 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:18.481361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:18.481815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:18.481480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:18.481815 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:18.481484    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:18.481815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:18.481520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:18.481815 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:18.481602    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:18.481815 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:18.481657    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:20.481177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:20.481144    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:20.481571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:20.481181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:20.481571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:20.481181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:20.481571 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:20.481279    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:20.481571 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:20.481358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:20.481571 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:20.481449    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:22.481645 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:22.481612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:22.482192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:22.481650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:22.482192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:22.481651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:22.482192 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:22.481723    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:22.482192 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:22.481861    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:22.482192 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:22.481947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:23.139325 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:23.139289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:23.139496 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:23.139345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:23.139496 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.139458    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:23.139496 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.139476    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:23.139667 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.139524    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.139506382 +0000 UTC m=+34.240981815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:23.139667 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.139539    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.139532738 +0000 UTC m=+34.241008169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:23.239708 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:23.239663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:23.239862 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.239842    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 14:35:23.239916 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.239864    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 14:35:23.239916 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.239874    2565 projected.go:196] Error preparing data for projected volume kube-api-access-dzkpb for pod openshift-network-diagnostics/network-check-target-pp25f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:23.240015 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:23.239918    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb podName:da55e0d6-8764-49a6-aa09-b4d690b04eac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.239906345 +0000 UTC m=+34.341381776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzkpb" (UniqueName: "kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb") pod "network-check-target-pp25f" (UID: "da55e0d6-8764-49a6-aa09-b4d690b04eac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 14:35:24.481682 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:24.481654    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:24.482074 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:24.481750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:24.482074 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:24.481759    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:24.482074 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:24.481854    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:24.482074 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:24.481759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:24.482074 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:24.481956    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:25.587332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:25.585754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trhl9" event={"ID":"df2b1ad7-35d0-4761-8a29-c2eeb829e1ea","Type":"ContainerStarted","Data":"ed4879beb375c6be787684f912418d61046db84ee95e293fb41427e23126d6b8"}
Sep 16 14:35:25.593347 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:25.592967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal" event={"ID":"feac09e4f283d3fc47947fc9e60141d8","Type":"ContainerStarted","Data":"7127e3f3d72cbe12a9a9789dbbc6ebe650fc3d62fefa483de30314efc209ae9d"}
Sep 16 14:35:25.629806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:25.629676    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trhl9" podStartSLOduration=2.863130126 podStartE2EDuration="20.629655227s" totalImagesPullingTime="17.766525101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:25.611428692 +0000 UTC m=+20.712904147" watchObservedRunningTime="2026-09-16 14:35:25.629655227 +0000 UTC m=+20.731130682"
Sep 16 14:35:25.629928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:25.629868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-124.ec2.internal" podStartSLOduration=18.629857176 podStartE2EDuration="18.629857176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:25.628913815 +0000 UTC m=+20.730389268" watchObservedRunningTime="2026-09-16 14:35:25.629857176 +0000 UTC m=+20.731332629"
Sep 16 14:35:26.481916 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.481755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:26.482064 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.481758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:26.482064 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:26.481997    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:26.482144 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:26.482087    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:26.482144 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.481756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:26.482210 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:26.482166    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:26.597082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.597054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv" event={"ID":"98d78855-378a-4dcd-94d4-db61c55e237e","Type":"ContainerStarted","Data":"955ab6daf171b8d30102b3b5df9baaf0a78c4614bd0e87fafeda18bdf005ddc8"}
Sep 16 14:35:26.598863 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.598832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcnmb" event={"ID":"e2886a41-3797-4d87-9519-98f78ae92f15","Type":"ContainerStarted","Data":"6f575b68342fcb594f817e4b792af4e92e3ff9a8a92fe92796e01735e12e6a2b"}
Sep 16 14:35:26.600699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.600667    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="ef99f57a21cee274ea25431cafb772a9ca7b9a1aad06aeb8b8bdc128309c8da9" exitCode=0
Sep 16 14:35:26.600806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.600749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"ef99f57a21cee274ea25431cafb772a9ca7b9a1aad06aeb8b8bdc128309c8da9"}
Sep 16 14:35:26.604321 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"47c22bf1cfe03dea47bcce9538da5c6a9a44245a8182b050dd207a9541360dfa"}
Sep 16 14:35:26.604421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"c57c041ebdf908f7683a0d5efca5ccd054ab86b80aae9d37befa2e4660717f87"}
Sep 16 14:35:26.604478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"c690946691321d5e364e290d3f1d93de29538e849e1d976c476dcc2bf6fab1b4"}
Sep 16 14:35:26.604544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"15323d83909b113e7b0ec0a3670c90b4ba191787ac1aa100510e3044b632052a"}
Sep 16 14:35:26.604544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"83e47f92c203bca20b020396f22a8ab601494828dd8321c6ecdc86b701a1a0ca"}
Sep 16 14:35:26.604636 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.604574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"eb3353c1ea64f7a524c6a5a251cb6152f985696c09e992476e96b34ee464fcfe"}
Sep 16 14:35:26.606146 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.606126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s2vwg" event={"ID":"74dcc4de-7619-4c93-abf9-2e2e771c3c27","Type":"ContainerStarted","Data":"15f3aff90b83daacff72e681321d5c8054523ba96f62b8d531b989456584b30c"}
Sep 16 14:35:26.607758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.607730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t8x6z" event={"ID":"98b0e16d-aeef-4155-8ea8-54d4ffd3131b","Type":"ContainerStarted","Data":"b48be484bafda744f83fca2ba90c40c3fae3d7107d775b898f5de82a56b1bf91"}
Sep 16 14:35:26.609353 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.609332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6b8lf" event={"ID":"fbcde4ed-12ca-4321-8675-2e40dfcffc6f","Type":"ContainerStarted","Data":"751f4dfa36b9e9bb4bcc181bc9e1910c88f7503acf125585f6ac90844279ccd9"}
Sep 16 14:35:26.644065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.644025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mcnmb" podStartSLOduration=2.907263614 podStartE2EDuration="20.644013565s" totalImagesPullingTime="17.736749951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:26.643711169 +0000 UTC m=+21.745186643" watchObservedRunningTime="2026-09-16 14:35:26.644013565 +0000 UTC m=+21.745489016"
Sep 16 14:35:26.689262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.689229    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6b8lf" podStartSLOduration=3.301531378 podStartE2EDuration="20.689218159s" totalImagesPullingTime="17.387686781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:26.6880184 +0000 UTC m=+21.789493866" watchObservedRunningTime="2026-09-16 14:35:26.689218159 +0000 UTC m=+21.790693611"
Sep 16 14:35:26.755727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:26.755628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t8x6z" podStartSLOduration=4.313126052 podStartE2EDuration="21.75561639s" totalImagesPullingTime="17.442490338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:26.755332649 +0000 UTC m=+21.856808101" watchObservedRunningTime="2026-09-16 14:35:26.75561639 +0000 UTC m=+21.857091843"
Sep 16 14:35:27.092500 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.092484    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 14:35:27.369324 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.369206    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T14:35:27.092497423Z","UUID":"9d28f931-c347-4d3b-bb68-ebca2c59a039","Handler":null,"Name":"","Endpoint":""}
Sep 16 14:35:27.370654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.370631    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 14:35:27.370755 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.370668    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 14:35:27.616037 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.614287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv" event={"ID":"98d78855-378a-4dcd-94d4-db61c55e237e","Type":"ContainerStarted","Data":"5186516a9896fe954c98ba6a979712d1094ee9d560ca757a51a50ac5d96a9fa7"}
Sep 16 14:35:27.617984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.617930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wjsz6" event={"ID":"6d068fed-3879-4a99-9a62-28438fa7f700","Type":"ContainerStarted","Data":"417b32930ccda6c2c1db457b969aeaddd5f7bd3e6229f376726001d5710a03d9"}
Sep 16 14:35:27.635361 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.635291    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s2vwg" podStartSLOduration=8.643641161 podStartE2EDuration="22.635279386s" totalImagesPullingTime="13.991638225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:26.805001568 +0000 UTC m=+21.906477020" watchObservedRunningTime="2026-09-16 14:35:27.635279386 +0000 UTC m=+22.736754838"
Sep 16 14:35:27.635674 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:27.635653    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wjsz6" podStartSLOduration=5.203217702 podStartE2EDuration="22.635647949s" totalImagesPullingTime="17.432430247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:27.63523242 +0000 UTC m=+22.736707891" watchObservedRunningTime="2026-09-16 14:35:27.635647949 +0000 UTC m=+22.737123400"
Sep 16 14:35:28.481020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.480932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:28.481020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.480962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:28.481020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.480962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:28.481231 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:28.481070    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:28.481231 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:28.481139    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:28.481307 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:28.481225    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:28.623233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.623205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"fc8ab98b8879cc02640ebf7c851e99e304367ec4b8d3f2611e3e4e62eb37a0ee"}
Sep 16 14:35:28.625163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.625140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv" event={"ID":"98d78855-378a-4dcd-94d4-db61c55e237e","Type":"ContainerStarted","Data":"a78d53e097da39eb57bacf97b7321945fb20eaf00aa1cc24d1d04ccb2471ab90"}
Sep 16 14:35:28.662154 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:28.662108    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j62bv" podStartSLOduration=3.799818268 podStartE2EDuration="23.662096586s" totalImagesPullingTime="19.862278318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:28.660801445 +0000 UTC m=+23.762276897" watchObservedRunningTime="2026-09-16 14:35:28.662096586 +0000 UTC m=+23.763572076"
Sep 16 14:35:30.121008 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.120977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:30.121628 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.121605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:30.481638 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.481457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:30.481638 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.481639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:30.481814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.481612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:30.481814 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:30.481728    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:30.482169 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:30.482127    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:30.482266 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:30.482248    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:30.635090 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.635024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" event={"ID":"8855e83e-ba71-4fa0-aa18-7a1a5d6c85cc","Type":"ContainerStarted","Data":"dc3ab23f1011808acde483bec69628d8b46d0b39303d31aeddc62bfb414dbbc7"}
Sep 16 14:35:30.669733 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:30.669691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r" podStartSLOduration=6.812038253 podStartE2EDuration="24.66967858s" totalImagesPullingTime="17.857640327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:30.669655349 +0000 UTC m=+25.771130801" watchObservedRunningTime="2026-09-16 14:35:30.66967858 +0000 UTC m=+25.771154033"
Sep 16 14:35:31.637776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:31.637639    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:31.637776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:31.637728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:31.637776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:31.637779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:31.654541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:31.654516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:31.654771 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:31.654754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:35:32.194740 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.194628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqtp9"]
Sep 16 14:35:32.194909 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.194761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:32.194909 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:32.194863    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:32.199084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.199059    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pp25f"]
Sep 16 14:35:32.199206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.199159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:32.199284 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:32.199252    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:32.199852 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.199822    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tkv5q"]
Sep 16 14:35:32.199932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:32.199921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:32.200054 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:32.200031    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:33.481304 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:33.481041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:33.481727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:33.481090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:33.481727 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:33.481421    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:33.481727 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:33.481457    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:33.642644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:33.642613    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="f87ed3329d78a52682f2b01a4b621917e3788fd364983ecb636605ad0157908f" exitCode=0
Sep 16 14:35:33.642807 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:33.642699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"f87ed3329d78a52682f2b01a4b621917e3788fd364983ecb636605ad0157908f"}
Sep 16 14:35:34.481491 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:34.481465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:34.481850 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:34.481576    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:35.481558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:35.481533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:35.481844 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:35.481623    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:35.481844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:35.481705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:35.481844 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:35.481795    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:35.649520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:35.649496    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="bd7a1bcbb000952f2f415761b7b0a1740d7592d8fe9c5d7791e23869182544fc" exitCode=0
Sep 16 14:35:35.649633 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:35.649547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"bd7a1bcbb000952f2f415761b7b0a1740d7592d8fe9c5d7791e23869182544fc"}
Sep 16 14:35:36.481715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:36.481689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:36.482074 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:36.481772    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pp25f" podUID="da55e0d6-8764-49a6-aa09-b4d690b04eac"
Sep 16 14:35:36.669152 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:36.669079    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:36.669277 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:36.669201    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 14:35:36.669729 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:36.669706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6b8lf"
Sep 16 14:35:37.481510 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:37.481300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:37.481626 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:37.481379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:37.481626 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:37.481565    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqtp9" podUID="73cd2c64-6381-4d12-b554-b56ad3035037"
Sep 16 14:35:37.481739 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:37.481625    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tkv5q" podUID="8bf35fc1-8936-4784-a329-fe71c5357342"
Sep 16 14:35:37.657268 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:37.657243    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="689c1f14ff4292d8a0aec08366aff8adbf808d5e8693d9879950f2844fb9a635" exitCode=0
Sep 16 14:35:37.657376 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:37.657287    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"689c1f14ff4292d8a0aec08366aff8adbf808d5e8693d9879950f2844fb9a635"}
Sep 16 14:35:38.214631 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.214579    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-124.ec2.internal" event="NodeReady"
Sep 16 14:35:38.214736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.214676    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 14:35:38.283611 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.283584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"]
Sep 16 14:35:38.287345 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.287323    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:35:38.287449 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.287438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.290989 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.290973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.291093 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.290974    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 16 14:35:38.291524 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.291507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.295462 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.295443    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"]
Sep 16 14:35:38.298813 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.298789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.309756 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.309732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.315820 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.315799    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"]
Sep 16 14:35:38.316737 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.316723    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2bpjj\""
Sep 16 14:35:38.318132 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.318112    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Sep 16 14:35:38.318639 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.318613    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret"
Sep 16 14:35:38.318709 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.318687    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap"
Sep 16 14:35:38.319179 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.319134    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-w8n7p\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w8n7p\"" type="*v1.Secret"
Sep 16 14:35:38.319268 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.319244    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret"
Sep 16 14:35:38.319725 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.319693    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 16 14:35:38.319889 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.319873    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"telemetry-config\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" type="*v1.ConfigMap"
Sep 16 14:35:38.319973 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.319931    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-dockercfg-w4sg7\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w4sg7\"" type="*v1.Secret"
Sep 16 14:35:38.320211 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.320154    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-monitoring-operator-tls\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" type="*v1.Secret"
Sep 16 14:35:38.320211 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.320195    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 16 14:35:38.346033 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.344881    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-fjrq7"]
Sep 16 14:35:38.348542 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.348521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"]
Sep 16 14:35:38.348648 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.348556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:35:38.348648 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.348633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.349001 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.348886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"]
Sep 16 14:35:38.352434 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.352302    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-tzr95"]
Sep 16 14:35:38.352576 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.352557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"
Sep 16 14:35:38.352670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.352610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9rscx\""
Sep 16 14:35:38.352740 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.352609    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.352987 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.352966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 16 14:35:38.353473 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.353454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 16 14:35:38.353561 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.353462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.355652 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.355633    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"]
Sep 16 14:35:38.355760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.355745    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.357932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.357913    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 16 14:35:38.358875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.358858    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"]
Sep 16 14:35:38.359009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.358993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.360643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.360628    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.362075 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.362058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.362923 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.362907    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.363270 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.363249    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ks7bv\""
Sep 16 14:35:38.364609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.364560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 16 14:35:38.366307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.366286    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wmlj2\""
Sep 16 14:35:38.366307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.366303    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.367649 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.367260    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.368154    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.368901    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.368912    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369201    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369473    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-48prg\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369854    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369866    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369780    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-srk5p\""
Sep 16 14:35:38.369995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.369976    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.370884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.370845    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 16 14:35:38.373623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.373607    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.380213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.379968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"]
Sep 16 14:35:38.398754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.398735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"]
Sep 16 14:35:38.399555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.399534    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fjrq7"]
Sep 16 14:35:38.409018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.408970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"]
Sep 16 14:35:38.409305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.409263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-tzr95"]
Sep 16 14:35:38.409988 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.409971    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5ff77fd8c6-khqvt"]
Sep 16 14:35:38.413598 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.413578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.420230 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.420203    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 16 14:35:38.420334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.420304    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 16 14:35:38.420334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.420324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gm2nv\""
Sep 16 14:35:38.420480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.420325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 16 14:35:38.420977 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.420960    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.423544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.423526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 16 14:35:38.424288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.424266    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zfbld"]
Sep 16 14:35:38.426748 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.426732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.427552 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.427538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.429273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.429253    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"]
Sep 16 14:35:38.432301 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.432279    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"
Sep 16 14:35:38.434155 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.434135    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ngzql"]
Sep 16 14:35:38.434923 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.434907    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.435223 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.435193    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"network-diagnostics-dockercfg-grgjd\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grgjd\"" type="*v1.Secret"
Sep 16 14:35:38.435456 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.435443    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.436806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.436786    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 14:35:38.436880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.436825    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8jq45\""
Sep 16 14:35:38.437421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.437404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.437532 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.437512    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 14:35:38.438096 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.438079    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 14:35:38.443859 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.443839    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 14:35:38.444848 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.444829    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 14:35:38.445037 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.445021    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbx5d\""
Sep 16 14:35:38.455841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-snapshots\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.455933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.455933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309c2440-fe07-409e-ab6d-e682563fd4b3-serving-cert\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.455933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j97gp\" (UniqueName: \"kubernetes.io/projected/ac15390f-fc71-45e3-8d68-7b2e4016489c-kube-api-access-j97gp\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d1c52d6-e464-4ead-ad7f-642bb908764a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.455997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6s4s\" (UniqueName: \"kubernetes.io/projected/915fdd91-6a41-4983-a853-1990edf3ecd6-kube-api-access-c6s4s\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d1c52d6-e464-4ead-ad7f-642bb908764a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456120 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309c2440-fe07-409e-ab6d-e682563fd4b3-config\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d90610ec-e1a6-4c4d-8424-7810501903ea-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/915fdd91-6a41-4983-a853-1990edf3ecd6-serving-cert\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-trusted-ca\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-config\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5n4\" (UniqueName: \"kubernetes.io/projected/064ea5f2-ea84-47af-9dfa-2340de7b94c9-kube-api-access-pg5n4\") pod \"volume-data-source-validator-86695b7cc7-8pg8z\" (UID: \"064ea5f2-ea84-47af-9dfa-2340de7b94c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fghcc\" (UniqueName: \"kubernetes.io/projected/309c2440-fe07-409e-ab6d-e682563fd4b3-kube-api-access-fghcc\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19c209c8-b20a-4dc8-aba9-d58efc443f30-serving-cert\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.456453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-tmp\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr72b\" (UniqueName: \"kubernetes.io/projected/0d1c52d6-e464-4ead-ad7f-642bb908764a-kube-api-access-gr72b\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgbq\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pllwl\" (UniqueName: \"kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ndg\" (UniqueName: \"kubernetes.io/projected/19c209c8-b20a-4dc8-aba9-d58efc443f30-kube-api-access-v4ndg\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.456819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.456540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-service-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.459733 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.459712    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ff77fd8c6-khqvt"]
Sep 16 14:35:38.461399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.461380    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zfbld"]
Sep 16 14:35:38.479139 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.479097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ngzql"]
Sep 16 14:35:38.481624 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.481608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:38.485298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.485284    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sr586\""
Sep 16 14:35:38.487298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.487273    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"]
Sep 16 14:35:38.557099 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fghcc\" (UniqueName: \"kubernetes.io/projected/309c2440-fe07-409e-ab6d-e682563fd4b3-kube-api-access-fghcc\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.557195 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.557195 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19c209c8-b20a-4dc8-aba9-d58efc443f30-serving-cert\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557195 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-tmp\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr72b\" (UniqueName: \"kubernetes.io/projected/0d1c52d6-e464-4ead-ad7f-642bb908764a-kube-api-access-gr72b\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgbq\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllwl\" (UniqueName: \"kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ndg\" (UniqueName: \"kubernetes.io/projected/19c209c8-b20a-4dc8-aba9-d58efc443f30-kube-api-access-v4ndg\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-stats-auth\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-service-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4k4q\" (UniqueName: \"kubernetes.io/projected/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-kube-api-access-d4k4q\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-snapshots\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309c2440-fe07-409e-ab6d-e682563fd4b3-serving-cert\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-tmp\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j97gp\" (UniqueName: \"kubernetes.io/projected/ac15390f-fc71-45e3-8d68-7b2e4016489c-kube-api-access-j97gp\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcp5\" (UniqueName: \"kubernetes.io/projected/1928edb1-0b8d-48f5-b03a-a1b45ca48245-kube-api-access-mxcp5\") pod \"network-check-source-6f8b768455-fd89k\" (UID: \"1928edb1-0b8d-48f5-b03a-a1b45ca48245\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"
Sep 16 14:35:38.557627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d1c52d6-e464-4ead-ad7f-642bb908764a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee543e3-bb68-472a-a025-a9b7386e8839-config-volume\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6s4s\" (UniqueName: \"kubernetes.io/projected/915fdd91-6a41-4983-a853-1990edf3ecd6-kube-api-access-c6s4s\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmrhx\" (UniqueName: \"kubernetes.io/projected/52a53c3c-043f-48ca-bb14-e6c6ac20492a-kube-api-access-tmrhx\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d1c52d6-e464-4ead-ad7f-642bb908764a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a53c3c-043f-48ca-bb14-e6c6ac20492a-cert\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.557929    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309c2440-fe07-409e-ab6d-e682563fd4b3-config\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.557978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.558163 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.558003    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.057987266 +0000 UTC m=+34.159462701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-service-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d90610ec-e1a6-4c4d-8424-7810501903ea-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/915fdd91-6a41-4983-a853-1990edf3ecd6-serving-cert\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0d1c52d6-e464-4ead-ad7f-642bb908764a-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-trusted-ca\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee543e3-bb68-472a-a025-a9b7386e8839-tmp-dir\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-config\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5n4\" (UniqueName: \"kubernetes.io/projected/064ea5f2-ea84-47af-9dfa-2340de7b94c9-kube-api-access-pg5n4\") pod \"volume-data-source-validator-86695b7cc7-8pg8z\" (UID: \"064ea5f2-ea84-47af-9dfa-2340de7b94c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6x7k\" (UniqueName: \"kubernetes.io/projected/3ee543e3-bb68-472a-a025-a9b7386e8839-kube-api-access-s6x7k\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-default-certificate\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/309c2440-fe07-409e-ab6d-e682563fd4b3-config\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.558913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.558722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.559487 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.559114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/19c209c8-b20a-4dc8-aba9-d58efc443f30-snapshots\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.559487 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.559411    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-config\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.559861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.559820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c209c8-b20a-4dc8-aba9-d58efc443f30-trusted-ca-bundle\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.559973 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.559867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/915fdd91-6a41-4983-a853-1990edf3ecd6-trusted-ca\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.562048 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.562026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d1c52d6-e464-4ead-ad7f-642bb908764a-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.562167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.562075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/309c2440-fe07-409e-ab6d-e682563fd4b3-serving-cert\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.562167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.562137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/915fdd91-6a41-4983-a853-1990edf3ecd6-serving-cert\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.562600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.562583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19c209c8-b20a-4dc8-aba9-d58efc443f30-serving-cert\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.573525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.573505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6s4s\" (UniqueName: \"kubernetes.io/projected/915fdd91-6a41-4983-a853-1990edf3ecd6-kube-api-access-c6s4s\") pod \"console-operator-696884fb9c-tzr95\" (UID: \"915fdd91-6a41-4983-a853-1990edf3ecd6\") " pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.573620 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.573524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgbq\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.577879 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.577856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fghcc\" (UniqueName: \"kubernetes.io/projected/309c2440-fe07-409e-ab6d-e682563fd4b3-kube-api-access-fghcc\") pod \"service-ca-operator-cf7c776b7-qt555\" (UID: \"309c2440-fe07-409e-ab6d-e682563fd4b3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.578054 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.578034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr72b\" (UniqueName: \"kubernetes.io/projected/0d1c52d6-e464-4ead-ad7f-642bb908764a-kube-api-access-gr72b\") pod \"kube-storage-version-migrator-operator-6c8f84f897-f55xf\" (UID: \"0d1c52d6-e464-4ead-ad7f-642bb908764a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.578130 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.578048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:38.584345 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.584296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j97gp\" (UniqueName: \"kubernetes.io/projected/ac15390f-fc71-45e3-8d68-7b2e4016489c-kube-api-access-j97gp\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:38.595127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.595096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ndg\" (UniqueName: \"kubernetes.io/projected/19c209c8-b20a-4dc8-aba9-d58efc443f30-kube-api-access-v4ndg\") pod \"insights-operator-5844b856db-fjrq7\" (UID: \"19c209c8-b20a-4dc8-aba9-d58efc443f30\") " pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.597033 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.597009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5n4\" (UniqueName: \"kubernetes.io/projected/064ea5f2-ea84-47af-9dfa-2340de7b94c9-kube-api-access-pg5n4\") pod \"volume-data-source-validator-86695b7cc7-8pg8z\" (UID: \"064ea5f2-ea84-47af-9dfa-2340de7b94c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"
Sep 16 14:35:38.659146 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-stats-auth\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.659265 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.659265 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4k4q\" (UniqueName: \"kubernetes.io/projected/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-kube-api-access-d4k4q\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.659265 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcp5\" (UniqueName: \"kubernetes.io/projected/1928edb1-0b8d-48f5-b03a-a1b45ca48245-kube-api-access-mxcp5\") pod \"network-check-source-6f8b768455-fd89k\" (UID: \"1928edb1-0b8d-48f5-b03a-a1b45ca48245\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"
Sep 16 14:35:38.659418 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee543e3-bb68-472a-a025-a9b7386e8839-config-volume\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.659418 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmrhx\" (UniqueName: \"kubernetes.io/projected/52a53c3c-043f-48ca-bb14-e6c6ac20492a-kube-api-access-tmrhx\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.659418 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.659337    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.159317613 +0000 UTC m=+34.260793061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:38.659418 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a53c3c-043f-48ca-bb14-e6c6ac20492a-cert\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.659601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.659601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee543e3-bb68-472a-a025-a9b7386e8839-tmp-dir\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.659895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee543e3-bb68-472a-a025-a9b7386e8839-tmp-dir\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.659895 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.659815    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:38.659895 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.659870    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.15985186 +0000 UTC m=+34.261327306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:38.660103 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6x7k\" (UniqueName: \"kubernetes.io/projected/3ee543e3-bb68-472a-a025-a9b7386e8839-kube-api-access-s6x7k\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.660103 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.659988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-default-certificate\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.660103 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.660021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.660103 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.660082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee543e3-bb68-472a-a025-a9b7386e8839-config-volume\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.660279 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.660154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-fjrq7"
Sep 16 14:35:38.660279 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.660154    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:38.660376 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:38.660301    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.160280201 +0000 UTC m=+34.261755637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:38.661755 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.661730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-stats-auth\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.661877 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.661859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52a53c3c-043f-48ca-bb14-e6c6ac20492a-cert\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.662206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.662180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-default-certificate\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.669480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.669339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"
Sep 16 14:35:38.676694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.676642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:38.679757 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.679713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6x7k\" (UniqueName: \"kubernetes.io/projected/3ee543e3-bb68-472a-a025-a9b7386e8839-kube-api-access-s6x7k\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:38.683356 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.683156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmrhx\" (UniqueName: \"kubernetes.io/projected/52a53c3c-043f-48ca-bb14-e6c6ac20492a-kube-api-access-tmrhx\") pod \"ingress-canary-zfbld\" (UID: \"52a53c3c-043f-48ca-bb14-e6c6ac20492a\") " pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.683356 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.683229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"
Sep 16 14:35:38.683928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.683906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcp5\" (UniqueName: \"kubernetes.io/projected/1928edb1-0b8d-48f5-b03a-a1b45ca48245-kube-api-access-mxcp5\") pod \"network-check-source-6f8b768455-fd89k\" (UID: \"1928edb1-0b8d-48f5-b03a-a1b45ca48245\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"
Sep 16 14:35:38.689734 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.689484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"
Sep 16 14:35:38.695950 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.695907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4k4q\" (UniqueName: \"kubernetes.io/projected/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-kube-api-access-d4k4q\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:38.741461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.739458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zfbld"
Sep 16 14:35:38.971495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.971458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:38.980581 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:38.980556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-fjrq7"]
Sep 16 14:35:38.983752 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:38.983724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c209c8_b20a_4dc8_aba9_d58efc443f30.slice/crio-d78ec8feec9e70a876254392a7bba46466df752b5e345f687080570c48f5ce4c WatchSource:0}: Error finding container d78ec8feec9e70a876254392a7bba46466df752b5e345f687080570c48f5ce4c: Status 404 returned error can't find the container with id d78ec8feec9e70a876254392a7bba46466df752b5e345f687080570c48f5ce4c
Sep 16 14:35:39.001195 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.000906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z"]
Sep 16 14:35:39.002166 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.002144    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555"]
Sep 16 14:35:39.003170 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.003118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-tzr95"]
Sep 16 14:35:39.005643 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.005618    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod064ea5f2_ea84_47af_9dfa_2340de7b94c9.slice/crio-641206ba57c05942b2154ad7d030241d27418dec84369659e2c71c421f9c40c8 WatchSource:0}: Error finding container 641206ba57c05942b2154ad7d030241d27418dec84369659e2c71c421f9c40c8: Status 404 returned error can't find the container with id 641206ba57c05942b2154ad7d030241d27418dec84369659e2c71c421f9c40c8
Sep 16 14:35:39.006326 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.006303    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915fdd91_6a41_4983_a853_1990edf3ecd6.slice/crio-130f6a7696c030cc3afa10e177bf2e6d5ad10c81212af54ee6f9b06b41be3221 WatchSource:0}: Error finding container 130f6a7696c030cc3afa10e177bf2e6d5ad10c81212af54ee6f9b06b41be3221: Status 404 returned error can't find the container with id 130f6a7696c030cc3afa10e177bf2e6d5ad10c81212af54ee6f9b06b41be3221
Sep 16 14:35:39.007002 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.006983    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod309c2440_fe07_409e_ab6d_e682563fd4b3.slice/crio-47e20dd5b292b3e623813f67c4494d4546687e0fc7dfe229255c28ef2c44da67 WatchSource:0}: Error finding container 47e20dd5b292b3e623813f67c4494d4546687e0fc7dfe229255c28ef2c44da67: Status 404 returned error can't find the container with id 47e20dd5b292b3e623813f67c4494d4546687e0fc7dfe229255c28ef2c44da67
Sep 16 14:35:39.030083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.030058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf"]
Sep 16 14:35:39.033287 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.033268    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1c52d6_e464_4ead_ad7f_642bb908764a.slice/crio-4880e7dea5d460b3ee66a960ba0cef9a22de6c3b6e983568c527f357aade5a77 WatchSource:0}: Error finding container 4880e7dea5d460b3ee66a960ba0cef9a22de6c3b6e983568c527f357aade5a77: Status 404 returned error can't find the container with id 4880e7dea5d460b3ee66a960ba0cef9a22de6c3b6e983568c527f357aade5a77
Sep 16 14:35:39.058281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.058260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zfbld"]
Sep 16 14:35:39.061481 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.061458    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a53c3c_043f_48ca_bb14_e6c6ac20492a.slice/crio-c36448ee64c7656fa4573e329b11536fd0c4921d7029ebeab3f0df0125656204 WatchSource:0}: Error finding container c36448ee64c7656fa4573e329b11536fd0c4921d7029ebeab3f0df0125656204: Status 404 returned error can't find the container with id c36448ee64c7656fa4573e329b11536fd0c4921d7029ebeab3f0df0125656204
Sep 16 14:35:39.065313 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.065287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:39.065456 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.065438    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:39.065536 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.065504    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.065485135 +0000 UTC m=+35.166960568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:39.166445 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.166421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.166456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.166485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.166535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166554    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.166567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166578    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:39.166621 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166602    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret podName:8bf35fc1-8936-4784-a329-fe71c5357342 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:11.16658614 +0000 UTC m=+66.268061587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret") pod "global-pull-secret-syncer-tkv5q" (UID: "8bf35fc1-8936-4784-a329-fe71c5357342") : object "kube-system"/"original-pull-secret" not registered
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166646    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.166638649 +0000 UTC m=+35.268114080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166658    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.16665274 +0000 UTC m=+35.268128171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166658    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.16668263 +0000 UTC m=+35.268158061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166709    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:39.166914 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.166770    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs podName:73cd2c64-6381-4d12-b554-b56ad3035037 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:11.166754824 +0000 UTC m=+66.268230271 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs") pod "network-metrics-daemon-bqtp9" (UID: "73cd2c64-6381-4d12-b554-b56ad3035037") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 14:35:39.244116 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.244050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:39.244929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.244914    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w8n7p\""
Sep 16 14:35:39.267436 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.267417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:39.270286 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.270266    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkpb\" (UniqueName: \"kubernetes.io/projected/da55e0d6-8764-49a6-aa09-b4d690b04eac-kube-api-access-dzkpb\") pod \"network-check-target-pp25f\" (UID: \"da55e0d6-8764-49a6-aa09-b4d690b04eac\") " pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:39.311520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.311306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-grgjd\""
Sep 16 14:35:39.315630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.315614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"
Sep 16 14:35:39.336979 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.336931    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w4sg7\""
Sep 16 14:35:39.352118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.352098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 16 14:35:39.355793 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.355774    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 16 14:35:39.358878 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.358848    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:39.358974 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.358919    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:39.858898443 +0000 UTC m=+34.960373887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:39.359575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.359556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d90610ec-e1a6-4c4d-8424-7810501903ea-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:39.391402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.391385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:39.481668 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.481639    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:35:39.481790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.481645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:35:39.488735 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.488518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:35:39.488735 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.488516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf8l5\""
Sep 16 14:35:39.488735 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.488541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:35:39.558583 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558561    2565 configmap.go:193] Couldn't get configMap openshift-image-registry/trusted-ca: failed to sync configmap cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558579    2565 secret.go:189] Couldn't get secret openshift-image-registry/installation-pull-secrets: failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558590    2565 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558562    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558635    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.058615238 +0000 UTC m=+35.160090683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca" (UniqueName: "kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : failed to sync configmap cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558641    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558653    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.058643962 +0000 UTC m=+35.160119398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "installation-pull-secrets" (UniqueName: "kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558669    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.058660119 +0000 UTC m=+35.160135554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.558689 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.558683    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.05867649 +0000 UTC m=+35.160151929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : failed to sync secret cache: timed out waiting for the condition
Sep 16 14:35:39.572900 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.572880    2565 projected.go:291] Couldn't get configMap openshift-monitoring/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 16 14:35:39.590521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.590503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 14:35:39.611608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.611583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-fd89k"]
Sep 16 14:35:39.617158 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.617123    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1928edb1_0b8d_48f5_b03a_a1b45ca48245.slice/crio-821321cedd2b37cfcd05b2e6a11e5f79cc62a57365960b21dcbba0dd5db3ed1a WatchSource:0}: Error finding container 821321cedd2b37cfcd05b2e6a11e5f79cc62a57365960b21dcbba0dd5db3ed1a: Status 404 returned error can't find the container with id 821321cedd2b37cfcd05b2e6a11e5f79cc62a57365960b21dcbba0dd5db3ed1a
Sep 16 14:35:39.666417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.666359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k" event={"ID":"1928edb1-0b8d-48f5-b03a-a1b45ca48245","Type":"ContainerStarted","Data":"821321cedd2b37cfcd05b2e6a11e5f79cc62a57365960b21dcbba0dd5db3ed1a"}
Sep 16 14:35:39.667778 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.667755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf" event={"ID":"0d1c52d6-e464-4ead-ad7f-642bb908764a","Type":"ContainerStarted","Data":"4880e7dea5d460b3ee66a960ba0cef9a22de6c3b6e983568c527f357aade5a77"}
Sep 16 14:35:39.669754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.669707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" event={"ID":"915fdd91-6a41-4983-a853-1990edf3ecd6","Type":"ContainerStarted","Data":"130f6a7696c030cc3afa10e177bf2e6d5ad10c81212af54ee6f9b06b41be3221"}
Sep 16 14:35:39.673349 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.673322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555" event={"ID":"309c2440-fe07-409e-ab6d-e682563fd4b3","Type":"ContainerStarted","Data":"47e20dd5b292b3e623813f67c4494d4546687e0fc7dfe229255c28ef2c44da67"}
Sep 16 14:35:39.674796 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.674750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z" event={"ID":"064ea5f2-ea84-47af-9dfa-2340de7b94c9","Type":"ContainerStarted","Data":"641206ba57c05942b2154ad7d030241d27418dec84369659e2c71c421f9c40c8"}
Sep 16 14:35:39.676384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.676315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zfbld" event={"ID":"52a53c3c-043f-48ca-bb14-e6c6ac20492a","Type":"ContainerStarted","Data":"c36448ee64c7656fa4573e329b11536fd0c4921d7029ebeab3f0df0125656204"}
Sep 16 14:35:39.677573 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.677529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fjrq7" event={"ID":"19c209c8-b20a-4dc8-aba9-d58efc443f30","Type":"ContainerStarted","Data":"d78ec8feec9e70a876254392a7bba46466df752b5e345f687080570c48f5ce4c"}
Sep 16 14:35:39.691637 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.691590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pp25f"]
Sep 16 14:35:39.694897 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:39.694872    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda55e0d6_8764_49a6_aa09_b4d690b04eac.slice/crio-ee17510eb15946c5a9e7c572dc3c159f350a9f68e95e678cda95e629cf46094a WatchSource:0}: Error finding container ee17510eb15946c5a9e7c572dc3c159f350a9f68e95e678cda95e629cf46094a: Status 404 returned error can't find the container with id ee17510eb15946c5a9e7c572dc3c159f350a9f68e95e678cda95e629cf46094a
Sep 16 14:35:39.728058 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.728003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 14:35:39.753962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.753891    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 14:35:39.779343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.779188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 14:35:39.784036 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.783999    2565 projected.go:196] Error preparing data for projected volume kube-api-access-pllwl for pod openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h: failed to sync configmap cache: timed out waiting for the condition
Sep 16 14:35:39.784138 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.784068    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.284048116 +0000 UTC m=+35.385523573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pllwl" (UniqueName: "kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : failed to sync configmap cache: timed out waiting for the condition
Sep 16 14:35:39.803963 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.803869    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 14:35:39.872577 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.872456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:39.872577 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.872577    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:39.872759 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:39.872652    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.87263002 +0000 UTC m=+35.974105456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:39.905334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:39.905312    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.074870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.074916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.074957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.074997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.075031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.076049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.076155    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.076211    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:35:42.076193498 +0000 UTC m=+37.177668931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.076586    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.076601    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: secret "image-registry-tls" not found
Sep 16 14:35:40.077360 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.076646    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:41.076631113 +0000 UTC m=+36.178106545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : secret "image-registry-tls" not found
Sep 16 14:35:40.086379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.086322    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.088016 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.087932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.176380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.176440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.176530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.176660    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.176714    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:42.176695726 +0000 UTC m=+37.278171159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.177077    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.177115    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:42.17710313 +0000 UTC m=+37.278578565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:40.177203 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.177169    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:42.17716114 +0000 UTC m=+37.278636578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:40.284047 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.282922    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"]
Sep 16 14:35:40.286815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.286249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.291747 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.291728    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nzdr6\""
Sep 16 14:35:40.291998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.291980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 14:35:40.292160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.292144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 14:35:40.312101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.312049    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"]
Sep 16 14:35:40.378291 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.378223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pllwl\" (UniqueName: \"kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:40.378428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.378289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.378428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.378416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77ab014f-8301-44c4-b786-840dbe71dd74-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.390207 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.390144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pllwl\" (UniqueName: \"kubernetes.io/projected/d90610ec-e1a6-4c4d-8424-7810501903ea-kube-api-access-pllwl\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:40.479967 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.478976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.479967 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.479111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77ab014f-8301-44c4-b786-840dbe71dd74-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.479967 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.479857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77ab014f-8301-44c4-b786-840dbe71dd74-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.480609 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.480314    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:40.480609 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.480386    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:40.980366548 +0000 UTC m=+36.081841984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:40.549628 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.549506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:40.689215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.689135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pp25f" event={"ID":"da55e0d6-8764-49a6-aa09-b4d690b04eac","Type":"ContainerStarted","Data":"ee17510eb15946c5a9e7c572dc3c159f350a9f68e95e678cda95e629cf46094a"}
Sep 16 14:35:40.768198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.768147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:40.882670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.882628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:40.882921 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.882903    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:40.883019 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.882995    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:42.882975487 +0000 UTC m=+37.984450935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:40.904378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.904162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:40.983723 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:40.983465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:40.983723 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.983601    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:40.983723 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:40.983655    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:41.983639395 +0000 UTC m=+37.085114844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:41.057897 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:41.057855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:41.084821 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:41.084588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:41.084821 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:41.084729    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:35:41.084821 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:41.084747    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: secret "image-registry-tls" not found
Sep 16 14:35:41.084821 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:41.084794    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:43.084777703 +0000 UTC m=+38.186253140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : secret "image-registry-tls" not found
Sep 16 14:35:41.696699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:41.696666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z" event={"ID":"064ea5f2-ea84-47af-9dfa-2340de7b94c9","Type":"ContainerStarted","Data":"137c5790bee8232a8def6898f1ea64f4e5877158b1135b6e7428c795dd25aa0b"}
Sep 16 14:35:41.962463 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:41.962358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:41.994432 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:41.994399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:41.994589 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:41.994561    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:41.994650 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:41.994643    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:43.994621498 +0000 UTC m=+39.096096932 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:42.095612 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.095577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:42.095780 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.095746    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:42.095832 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.095823    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:35:46.095801582 +0000 UTC m=+41.197277021 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:42.130450 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.130427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:42.197298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.197063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:42.197298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.197133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:42.197298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.197176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:42.197298 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.197198    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:42.197298 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.197265    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:46.197245092 +0000 UTC m=+41.298720536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:42.197612 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.197329    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:46.197314183 +0000 UTC m=+41.298789635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:42.197612 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.197424    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:42.197612 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.197457    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:46.197446866 +0000 UTC m=+41.298922300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:42.870174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.870109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:42.905132 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.905091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:42.905283 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.905232    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:42.905355 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:42.905342    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:46.905316456 +0000 UTC m=+42.006791890 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:42.971958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:42.971912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:43.106516 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:43.106484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:43.106662 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:43.106621    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:35:43.106662 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:43.106639    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: secret "image-registry-tls" not found
Sep 16 14:35:43.106756 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:43.106686    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:47.106672509 +0000 UTC m=+42.208147945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : secret "image-registry-tls" not found
Sep 16 14:35:44.014561 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:44.014525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:44.014985 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:44.014636    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:44.014985 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:44.014697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:48.014678823 +0000 UTC m=+43.116154255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:46.028701 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.028665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:46.130186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.130152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:46.130336 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.130281    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:46.130379 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.130347    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.130329362 +0000 UTC m=+49.231804808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:46.179916 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.179885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:46.230504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.230461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:46.230504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.230510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:46.230698 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.230614    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:46.230698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.230628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:46.230698 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.230680    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.230661993 +0000 UTC m=+49.332137438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:46.230698 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.230697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.230688632 +0000 UTC m=+49.332164070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:46.230874 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.230733    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:46.230874 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.230774    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.230760474 +0000 UTC m=+49.332235909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:46.405524 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.405442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:46.786170 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.786110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:46.934926 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.934886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:46.935099 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.934999    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:46.935099 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:46.935078    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.935061364 +0000 UTC m=+50.036536811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:46.998520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:46.998475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:47.135761 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:47.135699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:47.136092 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:47.135842    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:35:47.136092 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:47.135857    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: secret "image-registry-tls" not found
Sep 16 14:35:47.136092 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:47.135905    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:35:55.135891702 +0000 UTC m=+50.237367134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : secret "image-registry-tls" not found
Sep 16 14:35:47.455034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:47.454918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:47.606470 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:47.606435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:47.721698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:47.721597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:48.043076 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:48.043041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:48.043246 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:48.043167    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:48.043300 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:48.043250    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:35:56.043223941 +0000 UTC m=+51.144699395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:48.471917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:48.471840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:48.579689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:48.579651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:49.383583 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.383546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:49.725723 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.725686    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="625666f24ea25ef5f6081e1b15c5e51ab6c0d79150949f1bdc4ff38c2a10fe6b" exitCode=0
Sep 16 14:35:49.726143 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.725758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"625666f24ea25ef5f6081e1b15c5e51ab6c0d79150949f1bdc4ff38c2a10fe6b"}
Sep 16 14:35:49.727531 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.727511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k" event={"ID":"1928edb1-0b8d-48f5-b03a-a1b45ca48245","Type":"ContainerStarted","Data":"40a016fe02b1b9ef7c990cfae37b44888a06dfc929ada19d77532e2b99754994"}
Sep 16 14:35:49.729273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.729250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf" event={"ID":"0d1c52d6-e464-4ead-ad7f-642bb908764a","Type":"ContainerStarted","Data":"e84b5df270e7b05f0e5b6c145abff57db111c47a46fd2826616544ff919878a9"}
Sep 16 14:35:49.731557 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.731539    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/0.log"
Sep 16 14:35:49.731639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.731572    2565 generic.go:356] "Generic (PLEG): container finished" podID="915fdd91-6a41-4983-a853-1990edf3ecd6" containerID="963f5e4027e5515a691e293cb359a1f74ec0b1a91cb2576f91e61a68c91d8ac4" exitCode=255
Sep 16 14:35:49.731928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.731732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" event={"ID":"915fdd91-6a41-4983-a853-1990edf3ecd6","Type":"ContainerDied","Data":"963f5e4027e5515a691e293cb359a1f74ec0b1a91cb2576f91e61a68c91d8ac4"}
Sep 16 14:35:49.731928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.731854    2565 scope.go:117] "RemoveContainer" containerID="963f5e4027e5515a691e293cb359a1f74ec0b1a91cb2576f91e61a68c91d8ac4"
Sep 16 14:35:49.734213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.734016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pp25f" event={"ID":"da55e0d6-8764-49a6-aa09-b4d690b04eac","Type":"ContainerStarted","Data":"d48e8546af4f1029d809bcc881301166bc0ad8904eb4b069b8988abe07d12fcf"}
Sep 16 14:35:49.735814 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.735791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555" event={"ID":"309c2440-fe07-409e-ab6d-e682563fd4b3","Type":"ContainerStarted","Data":"aea12a3445b45b763537bdbbfe6943c5893061789ab2bed6a67d73cd31a39457"}
Sep 16 14:35:49.737702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.737681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zfbld" event={"ID":"52a53c3c-043f-48ca-bb14-e6c6ac20492a","Type":"ContainerStarted","Data":"749aac7ac7d41bd2679ec5b45a4833f2baf33d10b779cb84ee2f26bfd0294ca2"}
Sep 16 14:35:49.739264 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.739244    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fjrq7" event={"ID":"19c209c8-b20a-4dc8-aba9-d58efc443f30","Type":"ContainerStarted","Data":"1e5e9e3008e04858c545e9ee2c7e585f110f163c21763ce7223a5b256c19c686"}
Sep 16 14:35:49.775655 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.775614    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8pg8z" podStartSLOduration=11.810966581 podStartE2EDuration="13.77559983s" totalImagesPullingTime="1.964633249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:41.744312797 +0000 UTC m=+36.845788262" watchObservedRunningTime="2026-09-16 14:35:49.77559983 +0000 UTC m=+44.877075286"
Sep 16 14:35:49.804317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.804276    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555" podStartSLOduration=3.970803987 podStartE2EDuration="13.804258554s" totalImagesPullingTime="9.833454567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.803226204 +0000 UTC m=+44.904701659" watchObservedRunningTime="2026-09-16 14:35:49.804258554 +0000 UTC m=+44.905734009"
Sep 16 14:35:49.837811 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.837758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:49.922631 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.922579    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf" podStartSLOduration=4.113708185 podStartE2EDuration="13.92255639s" totalImagesPullingTime="9.808848205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.88573475 +0000 UTC m=+44.987210206" watchObservedRunningTime="2026-09-16 14:35:49.92255639 +0000 UTC m=+45.024031844"
Sep 16 14:35:49.957777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.957728    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pp25f" podStartSLOduration=34.664283187 podStartE2EDuration="43.957710493s" totalImagesPullingTime="9.293427306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.924060202 +0000 UTC m=+45.025535656" watchObservedRunningTime="2026-09-16 14:35:49.957710493 +0000 UTC m=+45.059185947"
Sep 16 14:35:49.958801 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.958757    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zfbld" podStartSLOduration=2.178042381 podStartE2EDuration="11.958736672s" totalImagesPullingTime="9.780694291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.957647472 +0000 UTC m=+45.059122929" watchObservedRunningTime="2026-09-16 14:35:49.958736672 +0000 UTC m=+45.060212127"
Sep 16 14:35:49.994704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:49.994625    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-fd89k" podStartSLOduration=4.761927415 podStartE2EDuration="13.994611471s" totalImagesPullingTime="9.232684056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:49.992747519 +0000 UTC m=+45.094222971" watchObservedRunningTime="2026-09-16 14:35:49.994611471 +0000 UTC m=+45.096086923"
Sep 16 14:35:50.016928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.016904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:50.034245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.034196    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-fjrq7" podStartSLOduration=4.175819236 podStartE2EDuration="14.034177088s" totalImagesPullingTime="9.858357852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:50.033616892 +0000 UTC m=+45.135092358" watchObservedRunningTime="2026-09-16 14:35:50.034177088 +0000 UTC m=+45.135652541"
Sep 16 14:35:50.274167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.274120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:50.372343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.372305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:50.746663 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.746591    2565 generic.go:356] "Generic (PLEG): container finished" podID="5638d4c9-da7d-4be3-9754-640016fde5df" containerID="4bd8ebb6e4d5d16fee4080e62740551d46a0114385c7b7f5d6505b6e3867f283" exitCode=0
Sep 16 14:35:50.747048 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.746666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerDied","Data":"4bd8ebb6e4d5d16fee4080e62740551d46a0114385c7b7f5d6505b6e3867f283"}
Sep 16 14:35:50.748288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748270    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:35:50.748680 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748660    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/0.log"
Sep 16 14:35:50.748782 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748692    2565 generic.go:356] "Generic (PLEG): container finished" podID="915fdd91-6a41-4983-a853-1990edf3ecd6" containerID="0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d" exitCode=255
Sep 16 14:35:50.748782 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" event={"ID":"915fdd91-6a41-4983-a853-1990edf3ecd6","Type":"ContainerDied","Data":"0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d"}
Sep 16 14:35:50.748989 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748788    2565 scope.go:117] "RemoveContainer" containerID="963f5e4027e5515a691e293cb359a1f74ec0b1a91cb2576f91e61a68c91d8ac4"
Sep 16 14:35:50.749043 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.748994    2565 scope.go:117] "RemoveContainer" containerID="0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d"
Sep 16 14:35:50.749239 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:50.749219    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-tzr95_openshift-console-operator(915fdd91-6a41-4983-a853-1990edf3ecd6)\"" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" podUID="915fdd91-6a41-4983-a853-1990edf3ecd6"
Sep 16 14:35:50.770869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.770848    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:35:50.813907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.813881    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cbwqq"]
Sep 16 14:35:50.840676 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.840661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.845427 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.845405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 14:35:50.847000 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.846397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 14:35:50.851281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.849269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbwqq"]
Sep 16 14:35:50.851281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.850730    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fz4cv\""
Sep 16 14:35:50.852980 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.852925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:50.867485 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.867457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0420fa52-f086-48b1-b582-5f10b1c9cfca-data-volume\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.867609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.867586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.867671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.867630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg67g\" (UniqueName: \"kubernetes.io/projected/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-api-access-cg67g\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.867741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.867675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0420fa52-f086-48b1-b582-5f10b1c9cfca-crio-socket\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.867741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.867710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.897800 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.897772    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"]
Sep 16 14:35:50.918500 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.918477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"
Sep 16 14:35:50.921187 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.921158    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 14:35:50.921268 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.921251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 14:35:50.921335 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.921251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mstkb\""
Sep 16 14:35:50.947317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.947277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"]
Sep 16 14:35:50.968628 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4qqf\" (UniqueName: \"kubernetes.io/projected/74c7d882-342f-4ebd-b3d2-10b9ad845caf-kube-api-access-n4qqf\") pod \"migrator-8b4d697c5-z84rq\" (UID: \"74c7d882-342f-4ebd-b3d2-10b9ad845caf\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"
Sep 16 14:35:50.968721 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0420fa52-f086-48b1-b582-5f10b1c9cfca-data-volume\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.968760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.968794 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg67g\" (UniqueName: \"kubernetes.io/projected/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-api-access-cg67g\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.968831 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0420fa52-f086-48b1-b582-5f10b1c9cfca-crio-socket\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.968880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.968928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0420fa52-f086-48b1-b582-5f10b1c9cfca-crio-socket\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.969005 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:50.968963    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:50.969005 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:50.968968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0420fa52-f086-48b1-b582-5f10b1c9cfca-data-volume\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:50.969005 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:50.968974    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:35:50.969138 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:50.969018    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:51.469001315 +0000 UTC m=+46.570476768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:50.969138 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:50.969031    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:51.469025076 +0000 UTC m=+46.570500507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : configmap "kube-rbac-proxy" not found
Sep 16 14:35:51.025414 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.025395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg67g\" (UniqueName: \"kubernetes.io/projected/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-api-access-cg67g\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:51.069387 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.069367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4qqf\" (UniqueName: \"kubernetes.io/projected/74c7d882-342f-4ebd-b3d2-10b9ad845caf-kube-api-access-n4qqf\") pod \"migrator-8b4d697c5-z84rq\" (UID: \"74c7d882-342f-4ebd-b3d2-10b9ad845caf\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"
Sep 16 14:35:51.108236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.108211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:51.117086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.117068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4qqf\" (UniqueName: \"kubernetes.io/projected/74c7d882-342f-4ebd-b3d2-10b9ad845caf-kube-api-access-n4qqf\") pod \"migrator-8b4d697c5-z84rq\" (UID: \"74c7d882-342f-4ebd-b3d2-10b9ad845caf\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"
Sep 16 14:35:51.226038 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.226016    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"
Sep 16 14:35:51.249329 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.249304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:51.473726 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.473694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:51.473862 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.473833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:51.473862 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:51.473847    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:51.473929 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:51.473907    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:35:51.473987 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:51.473929    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:52.473912202 +0000 UTC m=+47.575387633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:51.473987 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:51.473975    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:52.473958972 +0000 UTC m=+47.575434420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : configmap "kube-rbac-proxy" not found
Sep 16 14:35:51.508900 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.508874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq"]
Sep 16 14:35:51.511611 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:51.511589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c7d882_342f_4ebd_b3d2_10b9ad845caf.slice/crio-ffc639f3db439cc82c02aa02e133f63b3ae8ab169dff381da68620e362e6062b WatchSource:0}: Error finding container ffc639f3db439cc82c02aa02e133f63b3ae8ab169dff381da68620e362e6062b: Status 404 returned error can't find the container with id ffc639f3db439cc82c02aa02e133f63b3ae8ab169dff381da68620e362e6062b
Sep 16 14:35:51.753215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.753187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq" event={"ID":"74c7d882-342f-4ebd-b3d2-10b9ad845caf","Type":"ContainerStarted","Data":"ffc639f3db439cc82c02aa02e133f63b3ae8ab169dff381da68620e362e6062b"}
Sep 16 14:35:51.756716 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.756691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" event={"ID":"5638d4c9-da7d-4be3-9754-640016fde5df","Type":"ContainerStarted","Data":"80575702e4023de848c85af21fedc37ab657387ef6ac6abb83eed59142fbbb6b"}
Sep 16 14:35:51.758223 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.758207    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:35:51.758498 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.758482    2565 scope.go:117] "RemoveContainer" containerID="0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d"
Sep 16 14:35:51.758652 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:51.758634    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-tzr95_openshift-console-operator(915fdd91-6a41-4983-a853-1990edf3ecd6)\"" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" podUID="915fdd91-6a41-4983-a853-1990edf3ecd6"
Sep 16 14:35:51.795586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.795265    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6r2cz" podStartSLOduration=8.230150046 podStartE2EDuration="45.795248267s" totalImagesPullingTime="37.565098221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:51.794680685 +0000 UTC m=+46.896156137" watchObservedRunningTime="2026-09-16 14:35:51.795248267 +0000 UTC m=+46.896723720"
Sep 16 14:35:51.922399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:51.922374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:52.022956 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.022888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:52.096736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.096719    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t8x6z_98b0e16d-aeef-4155-8ea8-54d4ffd3131b/dns-node-resolver/0.log"
Sep 16 14:35:52.481805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.481772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:52.481976 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:52.481947    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:52.481976 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.481968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:52.482093 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:52.482022    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.482004404 +0000 UTC m=+49.583479852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:52.482093 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:52.482050    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 14:35:52.482190 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:52.482109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:54.482091853 +0000 UTC m=+49.583567290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : configmap "kube-rbac-proxy" not found
Sep 16 14:35:52.594864 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.594804    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4kpvq"]
Sep 16 14:35:52.611294 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.611207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.611886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.611862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4kpvq"]
Sep 16 14:35:52.619575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.619168    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 14:35:52.619575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.619408    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 14:35:52.620389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.620367    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 14:35:52.620488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.620409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t4txs\""
Sep 16 14:35:52.620551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.620523    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 14:35:52.644682 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.644656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:52.684009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.683989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-key\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.684122 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.684032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-cabundle\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.684181 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.684164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/794a17f1-a349-4f6a-b292-0d6ac7fb072c-kube-api-access-58qsh\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.784816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.784794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-cabundle\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.785172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.784864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/794a17f1-a349-4f6a-b292-0d6ac7fb072c-kube-api-access-58qsh\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.785172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.785041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-key\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.785522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.785506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-cabundle\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.787240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.787222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/794a17f1-a349-4f6a-b292-0d6ac7fb072c-signing-key\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.794291 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.794269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qsh\" (UniqueName: \"kubernetes.io/projected/794a17f1-a349-4f6a-b292-0d6ac7fb072c-kube-api-access-58qsh\") pod \"service-ca-568869fdc5-4kpvq\" (UID: \"794a17f1-a349-4f6a-b292-0d6ac7fb072c\") " pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:52.894018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.893969    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2vwg_74dcc4de-7619-4c93-abf9-2e2e771c3c27/node-ca/0.log"
Sep 16 14:35:52.923185 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:52.923162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-4kpvq"
Sep 16 14:35:53.468908 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.468167    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4kpvq"]
Sep 16 14:35:53.494924 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.494903    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zfbld_52a53c3c-043f-48ca-bb14-e6c6ac20492a/serve-healthcheck-canary/0.log"
Sep 16 14:35:53.560425 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:35:53.560398    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794a17f1_a349_4f6a_b292_0d6ac7fb072c.slice/crio-5002ec802c1531309b6772c0399b0bdc0868881286e5cdb8f07e265277d0896b WatchSource:0}: Error finding container 5002ec802c1531309b6772c0399b0bdc0868881286e5cdb8f07e265277d0896b: Status 404 returned error can't find the container with id 5002ec802c1531309b6772c0399b0bdc0868881286e5cdb8f07e265277d0896b
Sep 16 14:35:53.766312 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.766282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-4kpvq" event={"ID":"794a17f1-a349-4f6a-b292-0d6ac7fb072c","Type":"ContainerStarted","Data":"f64654235b5453e779800378acad81866c95abae5d069579c9fbedd51813b6d6"}
Sep 16 14:35:53.766411 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.766341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-4kpvq" event={"ID":"794a17f1-a349-4f6a-b292-0d6ac7fb072c","Type":"ContainerStarted","Data":"5002ec802c1531309b6772c0399b0bdc0868881286e5cdb8f07e265277d0896b"}
Sep 16 14:35:53.770196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.770173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq" event={"ID":"74c7d882-342f-4ebd-b3d2-10b9ad845caf","Type":"ContainerStarted","Data":"e60f0e6f71c9db4bce7b1622916ee3f481861c40e6338e97aaed2bf483fdcbcb"}
Sep 16 14:35:53.800836 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:53.800790    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-4kpvq" podStartSLOduration=1.800772098 podStartE2EDuration="1.800772098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:53.800117147 +0000 UTC m=+48.901592600" watchObservedRunningTime="2026-09-16 14:35:53.800772098 +0000 UTC m=+48.902247552"
Sep 16 14:35:54.180380 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.180355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:54.197771 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.197747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:35:54.197896 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.197879    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 16 14:35:54.197965 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.197948    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls podName:ac15390f-fc71-45e3-8d68-7b2e4016489c nodeName:}" failed. No retries permitted until 2026-09-16 14:36:10.197923798 +0000 UTC m=+65.299399229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-d297t" (UID: "ac15390f-fc71-45e3-8d68-7b2e4016489c") : secret "samples-operator-tls" not found
Sep 16 14:35:54.298803 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.298776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:35:54.298874 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.298844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:54.298921 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.298886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:35:54.298921 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.298905    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 14:35:54.299017 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.298973    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls podName:3ee543e3-bb68-472a-a025-a9b7386e8839 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:10.298955307 +0000 UTC m=+65.400430753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls") pod "dns-default-ngzql" (UID: "3ee543e3-bb68-472a-a025-a9b7386e8839") : secret "dns-default-metrics-tls" not found
Sep 16 14:35:54.299017 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.298996    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 16 14:35:54.299092 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.299027    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:10.299013144 +0000 UTC m=+65.400488579 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : configmap references non-existent config key: service-ca.crt
Sep 16 14:35:54.299092 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.299049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs podName:47edf677-aed3-4b53-a03b-f2d89d8fb5c8 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:10.299038283 +0000 UTC m=+65.400513718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs") pod "router-default-5ff77fd8c6-khqvt" (UID: "47edf677-aed3-4b53-a03b-f2d89d8fb5c8") : secret "router-metrics-certs-default" not found
Sep 16 14:35:54.339338 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.339312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:54.501544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.501524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:54.501619 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.501564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:54.501726 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.501714    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:54.501771 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:54.501761    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:35:58.501745767 +0000 UTC m=+53.603221201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:54.502117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.502097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0420fa52-f086-48b1-b582-5f10b1c9cfca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:54.776464 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.776376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq" event={"ID":"74c7d882-342f-4ebd-b3d2-10b9ad845caf","Type":"ContainerStarted","Data":"c8ed108d10d1967231a997a03aa85b167688a8512b575ab3d690eab872c788be"}
Sep 16 14:35:54.804650 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:54.804595    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-z84rq" podStartSLOduration=2.725502238 podStartE2EDuration="4.804580308s" totalImagesPullingTime="2.07907807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:35:54.803122561 +0000 UTC m=+49.904598027" watchObservedRunningTime="2026-09-16 14:35:54.804580308 +0000 UTC m=+49.906055760"
Sep 16 14:35:55.006583 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.006545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:35:55.006775 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:55.006712    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:55.006842 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:55.006793    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls podName:d90610ec-e1a6-4c4d-8424-7810501903ea nodeName:}" failed. No retries permitted until 2026-09-16 14:36:11.006772923 +0000 UTC m=+66.108248354 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-pmj4h" (UID: "d90610ec-e1a6-4c4d-8424-7810501903ea") : secret "cluster-monitoring-operator-tls" not found
Sep 16 14:35:55.208752 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.208676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:35:55.208891 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:55.208842    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 14:35:55.208891 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:55.208863    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-766866855f-6jc4m: secret "image-registry-tls" not found
Sep 16 14:35:55.209020 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:55.208914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls podName:6447bcc1-21f2-4566-a05e-2c0ee50d76ac nodeName:}" failed. No retries permitted until 2026-09-16 14:36:11.20889748 +0000 UTC m=+66.310372916 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls") pod "image-registry-766866855f-6jc4m" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac") : secret "image-registry-tls" not found
Sep 16 14:35:55.231495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.231460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:55.448613 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.448581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:55.603664 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.603620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:55.753369 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:55.753328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:56.118551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:56.118519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:35:56.118900 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:56.118635    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 14:35:56.118900 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:56.118688    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert podName:77ab014f-8301-44c4-b786-840dbe71dd74 nodeName:}" failed. No retries permitted until 2026-09-16 14:36:12.118674635 +0000 UTC m=+67.220150066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-8mmdd" (UID: "77ab014f-8301-44c4-b786-840dbe71dd74") : secret "networking-console-plugin-cert" not found
Sep 16 14:35:56.620331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:56.620291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:57.060237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:57.060193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:57.273523 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:57.273495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:57.554026 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:57.553998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:57.660965 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:57.660921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:58.538972 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.538925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:35:58.539339 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:58.539058    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:58.539339 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:58.539119    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls podName:0420fa52-f086-48b1-b582-5f10b1c9cfca nodeName:}" failed. No retries permitted until 2026-09-16 14:36:06.539104344 +0000 UTC m=+61.640579775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cbwqq" (UID: "0420fa52-f086-48b1-b582-5f10b1c9cfca") : secret "insights-runtime-extractor-tls" not found
Sep 16 14:35:58.578900 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.578860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:58.677208 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.677181    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:58.677337 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.677244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:35:58.677661 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.677641    2565 scope.go:117] "RemoveContainer" containerID="0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d"
Sep 16 14:35:58.677861 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:35:58.677837    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-tzr95_openshift-console-operator(915fdd91-6a41-4983-a853-1990edf3ecd6)\"" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" podUID="915fdd91-6a41-4983-a853-1990edf3ecd6"
Sep 16 14:35:58.717387 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.717356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:58.839288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:58.839238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:59.045069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:59.045044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:59.285735 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:59.285707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:59.409056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:59.409028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:59.535420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:59.535398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:35:59.696688 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:35:59.696635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:00.839495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:00.839470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:01.090823 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:01.090764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:01.207609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:01.207581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:01.329350 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:01.329325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:01.452886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:01.452839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:01.602690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:01.602669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:02.653703 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:02.653657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:02.822702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:02.822655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.098160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:03.098131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.336526 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:03.336498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.539830 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:03.539805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:03.657844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:03.657822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kpt4r"
Sep 16 14:36:03.844672 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:03.844616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:04.414675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:04.414644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:04.574381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:04.574345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:04.709029 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:04.708958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:05.346665 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:05.346632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:05.500655 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:05.500628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:05.625844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:05.625817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:06.605564 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:06.605521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:36:06.607827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:06.607804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0420fa52-f086-48b1-b582-5f10b1c9cfca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cbwqq\" (UID: \"0420fa52-f086-48b1-b582-5f10b1c9cfca\") " pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:36:06.755270 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:06.755238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fz4cv\""
Sep 16 14:36:06.763257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:06.763237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cbwqq"
Sep 16 14:36:07.045679 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:07.045644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cbwqq"]
Sep 16 14:36:07.050366 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:07.050341    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0420fa52_f086_48b1_b582_5f10b1c9cfca.slice/crio-2838eda3af7d8a63e0d21a25374bf4bbebc6e307c6071942b08f060ce2b3e02a WatchSource:0}: Error finding container 2838eda3af7d8a63e0d21a25374bf4bbebc6e307c6071942b08f060ce2b3e02a: Status 404 returned error can't find the container with id 2838eda3af7d8a63e0d21a25374bf4bbebc6e307c6071942b08f060ce2b3e02a
Sep 16 14:36:07.824316 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:07.824278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbwqq" event={"ID":"0420fa52-f086-48b1-b582-5f10b1c9cfca","Type":"ContainerStarted","Data":"30596fc667f4df843786e5b1b7e84a7ee24bfef086ba2e9a4a6e99ff75628c7d"}
Sep 16 14:36:07.824698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:07.824335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbwqq" event={"ID":"0420fa52-f086-48b1-b582-5f10b1c9cfca","Type":"ContainerStarted","Data":"2838eda3af7d8a63e0d21a25374bf4bbebc6e307c6071942b08f060ce2b3e02a"}
Sep 16 14:36:08.829855 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:08.829824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbwqq" event={"ID":"0420fa52-f086-48b1-b582-5f10b1c9cfca","Type":"ContainerStarted","Data":"2a2083d780c2d5fbfb978740e1dba4ef0b5caf353b39adf728a2b7bca439ffb6"}
Sep 16 14:36:10.238140 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.238061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:36:10.240461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.240437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ac15390f-fc71-45e3-8d68-7b2e4016489c-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-d297t\" (UID: \"ac15390f-fc71-45e3-8d68-7b2e4016489c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:36:10.339196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.339166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:36:10.339318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.339213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:10.339318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.339237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:10.339795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.339772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-service-ca-bundle\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:10.341666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.341639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee543e3-bb68-472a-a025-a9b7386e8839-metrics-tls\") pod \"dns-default-ngzql\" (UID: \"3ee543e3-bb68-472a-a025-a9b7386e8839\") " pod="openshift-dns/dns-default-ngzql"
Sep 16 14:36:10.341666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.341652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47edf677-aed3-4b53-a03b-f2d89d8fb5c8-metrics-certs\") pod \"router-default-5ff77fd8c6-khqvt\" (UID: \"47edf677-aed3-4b53-a03b-f2d89d8fb5c8\") " pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:10.401232 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.401207    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2bpjj\""
Sep 16 14:36:10.409592 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.409570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"
Sep 16 14:36:10.525810 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.525786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gm2nv\""
Sep 16 14:36:10.533211 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.533197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:10.553385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.553364    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbx5d\""
Sep 16 14:36:10.560930 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.560913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ngzql"
Sep 16 14:36:10.617537 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.617482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:10.687658 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.687635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t"]
Sep 16 14:36:10.832010 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.831988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ff77fd8c6-khqvt"]
Sep 16 14:36:10.833390 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:10.833370    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47edf677_aed3_4b53_a03b_f2d89d8fb5c8.slice/crio-0fd8c74f07f8d521cb6118523668ee217a089a4a26d7ef1bc12e14e941454945 WatchSource:0}: Error finding container 0fd8c74f07f8d521cb6118523668ee217a089a4a26d7ef1bc12e14e941454945: Status 404 returned error can't find the container with id 0fd8c74f07f8d521cb6118523668ee217a089a4a26d7ef1bc12e14e941454945
Sep 16 14:36:10.838657 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.838558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cbwqq" event={"ID":"0420fa52-f086-48b1-b582-5f10b1c9cfca","Type":"ContainerStarted","Data":"e313cc0e02e86f407f77d55a4e828b3bdadc10583d8dce47f4e5a85c58852740"}
Sep 16 14:36:10.839734 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.839706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t" event={"ID":"ac15390f-fc71-45e3-8d68-7b2e4016489c","Type":"ContainerStarted","Data":"f532d776e21a6b321dfc549d9f55243b383fa83a472ecd0055b30775dfd8ffa1"}
Sep 16 14:36:10.887196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.887170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ngzql"]
Sep 16 14:36:10.890278 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:10.890257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee543e3_bb68_472a_a025_a9b7386e8839.slice/crio-f86b69d877c24e61d7b8549d1cd2edf85fb3a9114ef0a01af80ed8bb88380693 WatchSource:0}: Error finding container f86b69d877c24e61d7b8549d1cd2edf85fb3a9114ef0a01af80ed8bb88380693: Status 404 returned error can't find the container with id f86b69d877c24e61d7b8549d1cd2edf85fb3a9114ef0a01af80ed8bb88380693
Sep 16 14:36:10.891221 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:10.891177    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cbwqq" podStartSLOduration=18.262556612 podStartE2EDuration="20.891157913s" totalImagesPullingTime="2.628601301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:10.890676712 +0000 UTC m=+65.992152170" watchObservedRunningTime="2026-09-16 14:36:10.891157913 +0000 UTC m=+65.992633367"
Sep 16 14:36:11.044228 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.044195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:36:11.046395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.046369    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d90610ec-e1a6-4c4d-8424-7810501903ea-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-pmj4h\" (UID: \"d90610ec-e1a6-4c4d-8424-7810501903ea\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:36:11.246575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.246517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:36:11.246882 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.246574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:36:11.246882 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.246603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:36:11.248736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.248718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"image-registry-766866855f-6jc4m\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") " pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:36:11.251527 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.251511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 14:36:11.251566 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.251541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 14:36:11.259200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.259182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73cd2c64-6381-4d12-b554-b56ad3035037-metrics-certs\") pod \"network-metrics-daemon-bqtp9\" (UID: \"73cd2c64-6381-4d12-b554-b56ad3035037\") " pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:36:11.259345 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.259327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8bf35fc1-8936-4784-a329-fe71c5357342-original-pull-secret\") pod \"global-pull-secret-syncer-tkv5q\" (UID: \"8bf35fc1-8936-4784-a329-fe71c5357342\") " pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:36:11.301876 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.301842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tkv5q"
Sep 16 14:36:11.301974 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.301958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf8l5\""
Sep 16 14:36:11.307904 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.307888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqtp9"
Sep 16 14:36:11.308408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.308392    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w8n7p\""
Sep 16 14:36:11.315535 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.315516    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w4sg7\""
Sep 16 14:36:11.315621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.315536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:36:11.322440 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.322421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"
Sep 16 14:36:11.592850 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.592817    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tkv5q"]
Sep 16 14:36:11.596060 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.596034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqtp9"]
Sep 16 14:36:11.596326 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:11.596296    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf35fc1_8936_4784_a329_fe71c5357342.slice/crio-9acc6b3348a82d75e07ff3a9183e2351cd521c7ffad8f8e0660b7941354b5f81 WatchSource:0}: Error finding container 9acc6b3348a82d75e07ff3a9183e2351cd521c7ffad8f8e0660b7941354b5f81: Status 404 returned error can't find the container with id 9acc6b3348a82d75e07ff3a9183e2351cd521c7ffad8f8e0660b7941354b5f81
Sep 16 14:36:11.599223 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:11.599201    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cd2c64_6381_4d12_b554_b56ad3035037.slice/crio-c26b5e4e743ffbbcf0a388291ceb735d10cc5fcb699941931df659f4cec2dfb3 WatchSource:0}: Error finding container c26b5e4e743ffbbcf0a388291ceb735d10cc5fcb699941931df659f4cec2dfb3: Status 404 returned error can't find the container with id c26b5e4e743ffbbcf0a388291ceb735d10cc5fcb699941931df659f4cec2dfb3
Sep 16 14:36:11.612684 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.612660    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:36:11.616767 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:11.616743    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6447bcc1_21f2_4566_a05e_2c0ee50d76ac.slice/crio-0e6a6b198932ce1cbb7a8f3c7be511a65883da3bf32261613d7fae71979f277a WatchSource:0}: Error finding container 0e6a6b198932ce1cbb7a8f3c7be511a65883da3bf32261613d7fae71979f277a: Status 404 returned error can't find the container with id 0e6a6b198932ce1cbb7a8f3c7be511a65883da3bf32261613d7fae71979f277a
Sep 16 14:36:11.627540 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.627517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h"]
Sep 16 14:36:11.630393 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:11.630369    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90610ec_e1a6_4c4d_8424_7810501903ea.slice/crio-9080f6b0a9fa5f1408443405791559db2936c0ff4778f1e58c4f5d94889279eb WatchSource:0}: Error finding container 9080f6b0a9fa5f1408443405791559db2936c0ff4778f1e58c4f5d94889279eb: Status 404 returned error can't find the container with id 9080f6b0a9fa5f1408443405791559db2936c0ff4778f1e58c4f5d94889279eb
Sep 16 14:36:11.846258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.846185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766866855f-6jc4m" event={"ID":"6447bcc1-21f2-4566-a05e-2c0ee50d76ac","Type":"ContainerStarted","Data":"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"}
Sep 16 14:36:11.846258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.846242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766866855f-6jc4m" event={"ID":"6447bcc1-21f2-4566-a05e-2c0ee50d76ac","Type":"ContainerStarted","Data":"0e6a6b198932ce1cbb7a8f3c7be511a65883da3bf32261613d7fae71979f277a"}
Sep 16 14:36:11.846456 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.846296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:36:11.847760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.847713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h" event={"ID":"d90610ec-e1a6-4c4d-8424-7810501903ea","Type":"ContainerStarted","Data":"9080f6b0a9fa5f1408443405791559db2936c0ff4778f1e58c4f5d94889279eb"}
Sep 16 14:36:11.849088 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.849037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tkv5q" event={"ID":"8bf35fc1-8936-4784-a329-fe71c5357342","Type":"ContainerStarted","Data":"9acc6b3348a82d75e07ff3a9183e2351cd521c7ffad8f8e0660b7941354b5f81"}
Sep 16 14:36:11.850789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.850759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt" event={"ID":"47edf677-aed3-4b53-a03b-f2d89d8fb5c8","Type":"ContainerStarted","Data":"de4e51ba8511aeb98bcd6f93019e67aeaba20df5a595fbf1a0a7338286632317"}
Sep 16 14:36:11.850891 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.850801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt" event={"ID":"47edf677-aed3-4b53-a03b-f2d89d8fb5c8","Type":"ContainerStarted","Data":"0fd8c74f07f8d521cb6118523668ee217a089a4a26d7ef1bc12e14e941454945"}
Sep 16 14:36:11.852302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.852261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ngzql" event={"ID":"3ee543e3-bb68-472a-a025-a9b7386e8839","Type":"ContainerStarted","Data":"f86b69d877c24e61d7b8549d1cd2edf85fb3a9114ef0a01af80ed8bb88380693"}
Sep 16 14:36:11.853570 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.853545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqtp9" event={"ID":"73cd2c64-6381-4d12-b554-b56ad3035037","Type":"ContainerStarted","Data":"c26b5e4e743ffbbcf0a388291ceb735d10cc5fcb699941931df659f4cec2dfb3"}
Sep 16 14:36:11.877241 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.877168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-766866855f-6jc4m" podStartSLOduration=65.877152718 podStartE2EDuration="1m5.877152718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:11.875925274 +0000 UTC m=+66.977400743" watchObservedRunningTime="2026-09-16 14:36:11.877152718 +0000 UTC m=+66.978628170"
Sep 16 14:36:11.900322 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:11.900275    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt" podStartSLOduration=35.90025828 podStartE2EDuration="35.90025828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:11.899698522 +0000 UTC m=+67.001173976" watchObservedRunningTime="2026-09-16 14:36:11.90025828 +0000 UTC m=+67.001733736"
Sep 16 14:36:12.156378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.156201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:36:12.158928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.158896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/77ab014f-8301-44c4-b786-840dbe71dd74-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-8mmdd\" (UID: \"77ab014f-8301-44c4-b786-840dbe71dd74\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:36:12.402560 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.402530    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-nzdr6\""
Sep 16 14:36:12.410199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.410143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"
Sep 16 14:36:12.533732 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.533703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:12.536776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.536754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:12.866253 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.865790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:12.867273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:12.867227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5ff77fd8c6-khqvt"
Sep 16 14:36:13.133834 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.133809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd"]
Sep 16 14:36:13.137304 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:13.137277    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ab014f_8301_44c4_b786_840dbe71dd74.slice/crio-edb06da88b6cefed3428fb208514357c4e1656e43466c5d882fa4b22fe200e21 WatchSource:0}: Error finding container edb06da88b6cefed3428fb208514357c4e1656e43466c5d882fa4b22fe200e21: Status 404 returned error can't find the container with id edb06da88b6cefed3428fb208514357c4e1656e43466c5d882fa4b22fe200e21
Sep 16 14:36:13.482006 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.481918    2565 scope.go:117] "RemoveContainer" containerID="0fafe34154f9fca31be78b166e19d40b4454d29b86ce830d3630bfaefe70ae5d"
Sep 16 14:36:13.866019 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.865983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqtp9" event={"ID":"73cd2c64-6381-4d12-b554-b56ad3035037","Type":"ContainerStarted","Data":"32b77c231d63f5b35c7b082b307e9ead4cf7266db732ec7f709f413c038d2aba"}
Sep 16 14:36:13.866182 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.866050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqtp9" event={"ID":"73cd2c64-6381-4d12-b554-b56ad3035037","Type":"ContainerStarted","Data":"1ab18e905d12cdedc466d67908e3a034f1fd3602dd63747a60cffaa722f9d076"}
Sep 16 14:36:13.868834 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.868756    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:36:13.868980 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.868847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" event={"ID":"915fdd91-6a41-4983-a853-1990edf3ecd6","Type":"ContainerStarted","Data":"fe6ae233f1319bca3390b15aed2f33bd5480c99f7feab91dd484ed09dda9bc61"}
Sep 16 14:36:13.869225 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.869197    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:36:13.871825 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.871801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t" event={"ID":"ac15390f-fc71-45e3-8d68-7b2e4016489c","Type":"ContainerStarted","Data":"37d84e8a655aea984cee3f7d76b969f2238fe2504c97c86b4016ae013e074a48"}
Sep 16 14:36:13.871903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.871850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t" event={"ID":"ac15390f-fc71-45e3-8d68-7b2e4016489c","Type":"ContainerStarted","Data":"7811f6ea1f7b191252c589df4bcb6c47e8090b137ffec2559060e8d339a26a46"}
Sep 16 14:36:13.873909 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.873735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd" event={"ID":"77ab014f-8301-44c4-b786-840dbe71dd74","Type":"ContainerStarted","Data":"edb06da88b6cefed3428fb208514357c4e1656e43466c5d882fa4b22fe200e21"}
Sep 16 14:36:13.890600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.890481    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bqtp9" podStartSLOduration=66.6387351 podStartE2EDuration="1m7.890464862s" totalImagesPullingTime="1.251729762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:13.890444314 +0000 UTC m=+68.991919768" watchObservedRunningTime="2026-09-16 14:36:13.890464862 +0000 UTC m=+68.991940315"
Sep 16 14:36:13.917135 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.917079    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-d297t" podStartSLOduration=35.789638603 podStartE2EDuration="37.917060989s" totalImagesPullingTime="2.127422386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:13.916537936 +0000 UTC m=+69.018013392" watchObservedRunningTime="2026-09-16 14:36:13.917060989 +0000 UTC m=+69.018536444"
Sep 16 14:36:13.937360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:13.937295    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-tzr95" podStartSLOduration=28.100320402 podStartE2EDuration="37.937261529s" totalImagesPullingTime="9.836941127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:13.937074972 +0000 UTC m=+69.038550426" watchObservedRunningTime="2026-09-16 14:36:13.937261529 +0000 UTC m=+69.038736982"
Sep 16 14:36:14.318439 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:14.318205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-tzr95"
Sep 16 14:36:14.563272 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:14.563237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:14.664926 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:14.664834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:14.870407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:14.870374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.052806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.052608    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"]
Sep 16 14:36:15.073378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.073344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"]
Sep 16 14:36:15.073378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.073376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.076854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.076823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 14:36:15.077858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.077830    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 14:36:15.077858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.077838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 14:36:15.078034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.077958    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 14:36:15.078216 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.078196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wk6kp\""
Sep 16 14:36:15.094111 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.093727    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.097507 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.097458    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 14:36:15.097736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.097645    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"]
Sep 16 14:36:15.098904 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.098861    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"]
Sep 16 14:36:15.104206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.104053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.119040 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.119019    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"]
Sep 16 14:36:15.154847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.154817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.156459 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.156409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"]
Sep 16 14:36:15.159848 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.158635    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-b5xvk"]
Sep 16 14:36:15.164034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.163464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 14:36:15.164034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.163911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 14:36:15.177290 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.177222    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 14:36:15.178451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.178431    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 14:36:15.190021 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.189993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/30fb1c13-cea7-4edd-911f-964f862e4948-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.190121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.190029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n8fm\" (UniqueName: \"kubernetes.io/projected/30fb1c13-cea7-4edd-911f-964f862e4948-kube-api-access-5n8fm\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.190121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.190057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfnft\" (UniqueName: \"kubernetes.io/projected/113047fa-e3fd-42b8-b049-210906a019f0-kube-api-access-rfnft\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.190121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.190106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30fb1c13-cea7-4edd-911f-964f862e4948-tmp\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.190292 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.190139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/113047fa-e3fd-42b8-b049-210906a019f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.195368 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.195343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-b5xvk"]
Sep 16 14:36:15.195473 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.195454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:15.198575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.198353    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 14:36:15.200149 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.200128    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 14:36:15.201452 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.201380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lnr6n\""
Sep 16 14:36:15.267762 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.267645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.290627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mhwl\" (UniqueName: \"kubernetes.io/projected/a9df8bde-040d-4bf4-ba66-48b4f724f003-kube-api-access-4mhwl\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9df8bde-040d-4bf4-ba66-48b4f724f003-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/30fb1c13-cea7-4edd-911f-964f862e4948-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.290764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n8fm\" (UniqueName: \"kubernetes.io/projected/30fb1c13-cea7-4edd-911f-964f862e4948-kube-api-access-5n8fm\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.291238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfnft\" (UniqueName: \"kubernetes.io/projected/113047fa-e3fd-42b8-b049-210906a019f0-kube-api-access-rfnft\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.291238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30fb1c13-cea7-4edd-911f-964f862e4948-tmp\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.291238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/113047fa-e3fd-42b8-b049-210906a019f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.291238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6dck\" (UniqueName: \"kubernetes.io/projected/8585dd39-eccd-4014-b4a0-d35fdeaca3e8-kube-api-access-p6dck\") pod \"downloads-76f99584f4-b5xvk\" (UID: \"8585dd39-eccd-4014-b4a0-d35fdeaca3e8\") " pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:15.291238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.290929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.291595 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.291568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30fb1c13-cea7-4edd-911f-964f862e4948-tmp\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.294118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.294077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/30fb1c13-cea7-4edd-911f-964f862e4948-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.294484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.294460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/113047fa-e3fd-42b8-b049-210906a019f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.303911 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.303851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n8fm\" (UniqueName: \"kubernetes.io/projected/30fb1c13-cea7-4edd-911f-964f862e4948-kube-api-access-5n8fm\") pod \"klusterlet-addon-workmgr-56c7d7bc76-h4rkj\" (UID: \"30fb1c13-cea7-4edd-911f-964f862e4948\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.306350 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.306301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfnft\" (UniqueName: \"kubernetes.io/projected/113047fa-e3fd-42b8-b049-210906a019f0-kube-api-access-rfnft\") pod \"managed-serviceaccount-addon-agent-6c88c978bd-tfq9c\" (UID: \"113047fa-e3fd-42b8-b049-210906a019f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.391299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6dck\" (UniqueName: \"kubernetes.io/projected/8585dd39-eccd-4014-b4a0-d35fdeaca3e8-kube-api-access-p6dck\") pod \"downloads-76f99584f4-b5xvk\" (UID: \"8585dd39-eccd-4014-b4a0-d35fdeaca3e8\") " pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:15.391435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.391435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.391435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.391607 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mhwl\" (UniqueName: \"kubernetes.io/projected/a9df8bde-040d-4bf4-ba66-48b4f724f003-kube-api-access-4mhwl\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.391607 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.391607 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.391501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9df8bde-040d-4bf4-ba66-48b4f724f003-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.392277 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.392238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9df8bde-040d-4bf4-ba66-48b4f724f003-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.393364 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.393182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"
Sep 16 14:36:15.394302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.394277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-ca\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.394374 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.394363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.394435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.394381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.395167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.395140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9df8bde-040d-4bf4-ba66-48b4f724f003-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.403244 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.403227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mhwl\" (UniqueName: \"kubernetes.io/projected/a9df8bde-040d-4bf4-ba66-48b4f724f003-kube-api-access-4mhwl\") pod \"cluster-proxy-proxy-agent-6b46ccb488-c6t44\" (UID: \"a9df8bde-040d-4bf4-ba66-48b4f724f003\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.407423 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.407405    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6dck\" (UniqueName: \"kubernetes.io/projected/8585dd39-eccd-4014-b4a0-d35fdeaca3e8-kube-api-access-p6dck\") pod \"downloads-76f99584f4-b5xvk\" (UID: \"8585dd39-eccd-4014-b4a0-d35fdeaca3e8\") " pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:15.409167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.409149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:15.469963 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.469930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"
Sep 16 14:36:15.514986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.514961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.516790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.516776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:15.642042 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.641991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.746848 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.746819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:15.854477 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:15.854453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:16.278065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:16.278005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:16.569430 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:16.569351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:16.802233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:16.802199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:17.695007 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.694976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"]
Sep 16 14:36:17.696217 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:17.696189    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fb1c13_cea7_4edd_911f_964f862e4948.slice/crio-92078519727b154b1470dfc833062d1ea2138e749d4f1b2f70471002e287db6b WatchSource:0}: Error finding container 92078519727b154b1470dfc833062d1ea2138e749d4f1b2f70471002e287db6b: Status 404 returned error can't find the container with id 92078519727b154b1470dfc833062d1ea2138e749d4f1b2f70471002e287db6b
Sep 16 14:36:17.710831 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.710774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c"]
Sep 16 14:36:17.713572 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:17.713545    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod113047fa_e3fd_42b8_b049_210906a019f0.slice/crio-ad656f328f36d3c4fc62fb209ee8de62e01a6053b5ac26f15dc5e6c4f9dd0102 WatchSource:0}: Error finding container ad656f328f36d3c4fc62fb209ee8de62e01a6053b5ac26f15dc5e6c4f9dd0102: Status 404 returned error can't find the container with id ad656f328f36d3c4fc62fb209ee8de62e01a6053b5ac26f15dc5e6c4f9dd0102
Sep 16 14:36:17.735993 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.735917    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-b5xvk"]
Sep 16 14:36:17.737061 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:17.737020    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9df8bde_040d_4bf4_ba66_48b4f724f003.slice/crio-0552bfb3e996cbbd7608fd2f169be544f90709b99a070aff10c80aba91a19ef6 WatchSource:0}: Error finding container 0552bfb3e996cbbd7608fd2f169be544f90709b99a070aff10c80aba91a19ef6: Status 404 returned error can't find the container with id 0552bfb3e996cbbd7608fd2f169be544f90709b99a070aff10c80aba91a19ef6
Sep 16 14:36:17.739099 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:17.739075    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8585dd39_eccd_4014_b4a0_d35fdeaca3e8.slice/crio-5877a4c182b5f882ab2cafbc1a9ed9cc62e483b2528385daaae51d6440f0e09b WatchSource:0}: Error finding container 5877a4c182b5f882ab2cafbc1a9ed9cc62e483b2528385daaae51d6440f0e09b: Status 404 returned error can't find the container with id 5877a4c182b5f882ab2cafbc1a9ed9cc62e483b2528385daaae51d6440f0e09b
Sep 16 14:36:17.748616 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.748592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44"]
Sep 16 14:36:17.891766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.891727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd" event={"ID":"77ab014f-8301-44c4-b786-840dbe71dd74","Type":"ContainerStarted","Data":"9ff9abf2b6aa8d303752eea25022ba91a929693acd0d4c1fd4e13797acc32b90"}
Sep 16 14:36:17.893111 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.893088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44" event={"ID":"a9df8bde-040d-4bf4-ba66-48b4f724f003","Type":"ContainerStarted","Data":"0552bfb3e996cbbd7608fd2f169be544f90709b99a070aff10c80aba91a19ef6"}
Sep 16 14:36:17.894317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.894290    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj" event={"ID":"30fb1c13-cea7-4edd-911f-964f862e4948","Type":"ContainerStarted","Data":"92078519727b154b1470dfc833062d1ea2138e749d4f1b2f70471002e287db6b"}
Sep 16 14:36:17.895712 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.895688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c" event={"ID":"113047fa-e3fd-42b8-b049-210906a019f0","Type":"ContainerStarted","Data":"ad656f328f36d3c4fc62fb209ee8de62e01a6053b5ac26f15dc5e6c4f9dd0102"}
Sep 16 14:36:17.897754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.897728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h" event={"ID":"d90610ec-e1a6-4c4d-8424-7810501903ea","Type":"ContainerStarted","Data":"c7e04908f5a6419dbdad62ab1ad0bf306412dcd49037b985313c358f794bef8e"}
Sep 16 14:36:17.900698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.900666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tkv5q" event={"ID":"8bf35fc1-8936-4784-a329-fe71c5357342","Type":"ContainerStarted","Data":"c421adfc07f9b7b428fa8d718121c06f040be821dbe01e0c7528e98b42d135dd"}
Sep 16 14:36:17.902617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.902591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ngzql" event={"ID":"3ee543e3-bb68-472a-a025-a9b7386e8839","Type":"ContainerStarted","Data":"35cd9b2da28360006bbd9b1dae0fc39b9af23ae79b291f0e4d921cb8c520041f"}
Sep 16 14:36:17.902730 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.902633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ngzql" event={"ID":"3ee543e3-bb68-472a-a025-a9b7386e8839","Type":"ContainerStarted","Data":"31e7c67fcd0bf968b5c9e5e00cd8ef42d249f14164467970984fe13f144c8179"}
Sep 16 14:36:17.902730 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.902661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ngzql"
Sep 16 14:36:17.903860 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:17.903843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-b5xvk" event={"ID":"8585dd39-eccd-4014-b4a0-d35fdeaca3e8","Type":"ContainerStarted","Data":"5877a4c182b5f882ab2cafbc1a9ed9cc62e483b2528385daaae51d6440f0e09b"}
Sep 16 14:36:18.046479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.046431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ngzql" podStartSLOduration=33.564740352 podStartE2EDuration="40.046415428s" totalImagesPullingTime="6.481675076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:18.045103384 +0000 UTC m=+73.146578836" watchObservedRunningTime="2026-09-16 14:36:18.046415428 +0000 UTC m=+73.147890873"
Sep 16 14:36:18.047049 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.047017    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-8mmdd" podStartSLOduration=33.803542821 podStartE2EDuration="38.047007777s" totalImagesPullingTime="4.243464956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:17.973539795 +0000 UTC m=+73.075015247" watchObservedRunningTime="2026-09-16 14:36:18.047007777 +0000 UTC m=+73.148483230"
Sep 16 14:36:18.084593 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.084564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:18.158862 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.158821    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tkv5q" podStartSLOduration=66.062037984 podStartE2EDuration="1m12.158807705s" totalImagesPullingTime="6.096769721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 14:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:18.154178398 +0000 UTC m=+73.255653851" watchObservedRunningTime="2026-09-16 14:36:18.158807705 +0000 UTC m=+73.260283149"
Sep 16 14:36:18.196083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.196048    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-pmj4h" podStartSLOduration=36.444639427 podStartE2EDuration="42.196034576s" totalImagesPullingTime="5.751395149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:18.194958431 +0000 UTC m=+73.296433885" watchObservedRunningTime="2026-09-16 14:36:18.196034576 +0000 UTC m=+73.297510029"
Sep 16 14:36:18.332239 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.332181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:18.571289 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.571240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:18.747988 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.747890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:18.922745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:18.922701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:20.069325 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:20.069174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:20.300813 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:20.300777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:21.760614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:21.760583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pp25f"
Sep 16 14:36:22.631907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:22.631871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:22.732875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:22.732838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:23.455723 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:23.455680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:23.655984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:23.655890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:23.759323 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:23.759230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:25.433632 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.433598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:25.803632 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.803539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:25.953512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.953431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44" event={"ID":"a9df8bde-040d-4bf4-ba66-48b4f724f003","Type":"ContainerStarted","Data":"a8b447108d3246a15b8cc0af318623e8a1dd5fdfe8320a906b5cba93ba86df4f"}
Sep 16 14:36:25.953512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.953488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44" event={"ID":"a9df8bde-040d-4bf4-ba66-48b4f724f003","Type":"ContainerStarted","Data":"6eeb9c7dc9ab800ea3bae9818c389c3bf9c3a5cb768089f1416a6a26c87a40bb"}
Sep 16 14:36:25.953512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.953507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44" event={"ID":"a9df8bde-040d-4bf4-ba66-48b4f724f003","Type":"ContainerStarted","Data":"bc3d1a961af7156d9f07da08f45171c351ee426fc787d1dcafdafb9afb826f93"}
Sep 16 14:36:25.955640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.955610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj" event={"ID":"30fb1c13-cea7-4edd-911f-964f862e4948","Type":"ContainerStarted","Data":"dd48abe9bb653fd7d4c3285b7903f3fdc5030855266b87809d3065d749741fb3"}
Sep 16 14:36:25.955752 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.955697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:25.957408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.957387    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj"
Sep 16 14:36:25.958184 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.958158    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c" event={"ID":"113047fa-e3fd-42b8-b049-210906a019f0","Type":"ContainerStarted","Data":"7b6f1187b17367245b3db9b642bd08ea054d236c35442a5ded52b40cf42b52e4"}
Sep 16 14:36:25.994767 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.994710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c7d7bc76-h4rkj" podStartSLOduration=3.065255489 podStartE2EDuration="10.994691817s" totalImagesPullingTime="7.929436328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:25.993805315 +0000 UTC m=+81.095280769" watchObservedRunningTime="2026-09-16 14:36:25.994691817 +0000 UTC m=+81.096167271"
Sep 16 14:36:25.994889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:25.994814    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b46ccb488-c6t44" podStartSLOduration=3.089373228 podStartE2EDuration="10.994808117s" totalImagesPullingTime="7.905434889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:25.976051859 +0000 UTC m=+81.077527319" watchObservedRunningTime="2026-09-16 14:36:25.994808117 +0000 UTC m=+81.096283570"
Sep 16 14:36:26.018948 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:26.018902    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c88c978bd-tfq9c" podStartSLOduration=3.09393715 podStartE2EDuration="11.01888989s" totalImagesPullingTime="7.92495274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:26.018640775 +0000 UTC m=+81.120116229" watchObservedRunningTime="2026-09-16 14:36:26.01888989 +0000 UTC m=+81.120365342"
Sep 16 14:36:26.820625 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:26.820538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.070238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.070200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.166467 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.166396    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2xkkn"]
Sep 16 14:36:27.170385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.170364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.173301 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.173279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 14:36:27.173426 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.173405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 14:36:27.173531 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.173513    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tdjzx\""
Sep 16 14:36:27.174361 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.174337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 14:36:27.174455 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.174364    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 14:36:27.218285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.218261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.294918 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.294892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-tls\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.294963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455dk\" (UniqueName: \"kubernetes.io/projected/894fb037-2f78-4077-a54f-3d8effccf01c-kube-api-access-455dk\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-sys\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-metrics-client-ca\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-textfile\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-root\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.295246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.295230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-wtmp\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.326483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.326455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.396521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-tls\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396624 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396624 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455dk\" (UniqueName: \"kubernetes.io/projected/894fb037-2f78-4077-a54f-3d8effccf01c-kube-api-access-455dk\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396624 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-sys\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396785 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396785 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-metrics-client-ca\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.396785 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.396701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-textfile\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397037 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-textfile\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-sys\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-root\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-wtmp\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-wtmp\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-accelerators-collector-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/894fb037-2f78-4077-a54f-3d8effccf01c-root\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.397442 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.397370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/894fb037-2f78-4077-a54f-3d8effccf01c-metrics-client-ca\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.399215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.399099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-tls\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.399614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.399591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/894fb037-2f78-4077-a54f-3d8effccf01c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.418642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.418597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455dk\" (UniqueName: \"kubernetes.io/projected/894fb037-2f78-4077-a54f-3d8effccf01c-kube-api-access-455dk\") pod \"node-exporter-2xkkn\" (UID: \"894fb037-2f78-4077-a54f-3d8effccf01c\") " pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.440670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.440642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.482727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.482671    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2xkkn"
Sep 16 14:36:27.496349 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:36:27.496319    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894fb037_2f78_4077_a54f_3d8effccf01c.slice/crio-a2a5c38d3b5908e8c01f5df34b65b276cd73020115c6f88698925b5a4fa9a614 WatchSource:0}: Error finding container a2a5c38d3b5908e8c01f5df34b65b276cd73020115c6f88698925b5a4fa9a614: Status 404 returned error can't find the container with id a2a5c38d3b5908e8c01f5df34b65b276cd73020115c6f88698925b5a4fa9a614
Sep 16 14:36:27.534429 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.534353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:27.911287 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.911172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ngzql"
Sep 16 14:36:27.969492 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:27.969425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xkkn" event={"ID":"894fb037-2f78-4077-a54f-3d8effccf01c","Type":"ContainerStarted","Data":"a2a5c38d3b5908e8c01f5df34b65b276cd73020115c6f88698925b5a4fa9a614"}
Sep 16 14:36:28.001444 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.001400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.203901 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.203809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.468512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.468442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.595364 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.593780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.692539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.692505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.799357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.799330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:28.981405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.981341    2565 generic.go:356] "Generic (PLEG): container finished" podID="894fb037-2f78-4077-a54f-3d8effccf01c" containerID="76b8aa5c6874734f62513092fc4961ca9d6a8de2928772dd52ec4f37e5f5debd" exitCode=0
Sep 16 14:36:28.981405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.981405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xkkn" event={"ID":"894fb037-2f78-4077-a54f-3d8effccf01c","Type":"ContainerDied","Data":"76b8aa5c6874734f62513092fc4961ca9d6a8de2928772dd52ec4f37e5f5debd"}
Sep 16 14:36:28.995435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:28.995408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:29.593484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:29.593446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:29.935734 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:29.935651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:29.989241 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:29.989207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xkkn" event={"ID":"894fb037-2f78-4077-a54f-3d8effccf01c","Type":"ContainerStarted","Data":"9dd79470bc8f9f940866f15eaf637bde7ce44619cc75394bd182334d36927fd5"}
Sep 16 14:36:29.989734 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:29.989266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2xkkn" event={"ID":"894fb037-2f78-4077-a54f-3d8effccf01c","Type":"ContainerStarted","Data":"22feaa28540de9171dd4ecbac1b06d453770c32393a5649200961fd01ec2800e"}
Sep 16 14:36:30.031421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:30.031369    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2xkkn" podStartSLOduration=1.742584541 podStartE2EDuration="3.03135427s" totalImagesPullingTime="1.222996538s" totalInitContainerRuntime="65.773191ms" isStatefulPod=true podCreationTimestamp="2026-09-16 14:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:30.030408221 +0000 UTC m=+85.131883677" watchObservedRunningTime="2026-09-16 14:36:30.03135427 +0000 UTC m=+85.132829723"
Sep 16 14:36:30.424231 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:30.424195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:30.531290 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:30.531257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:30.733199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:30.733115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:30.864617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:30.864580    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:31.321691 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:31.321652    2565 patch_prober.go:28] interesting pod/image-registry-766866855f-6jc4m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 14:36:31.322133 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:31.321718    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-766866855f-6jc4m" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:36:31.847081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:31.847028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:31.944690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:31.944652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:32.388579 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:32.388544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:32.863082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:32.863053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:36:33.139950 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:33.139840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:33.244160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:33.244116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:34.175762 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:34.175722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:34.641549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:34.641508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:34.903284 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:34.903191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:35.033753 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:35.033710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:36.414746 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:36.414710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:36.622473 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:36.622441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:36.748953 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:36.748830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:37.173286 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:37.173212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:37.272285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:37.272251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:37.485679 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:37.485598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:38.433815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:38.433780    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:36:38.770662 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:38.770627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:38.964698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:38.964657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:39.032534 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:39.032446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-b5xvk" event={"ID":"8585dd39-eccd-4014-b4a0-d35fdeaca3e8","Type":"ContainerStarted","Data":"b28259e71eae0597522016a6d0e7e6704ef7c84ffaa8922e5b7fac37b7f0e156"}
Sep 16 14:36:39.032700 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:39.032674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:39.049862 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:39.049835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-b5xvk"
Sep 16 14:36:39.077515 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:39.077465    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-b5xvk" podStartSLOduration=3.849942017 podStartE2EDuration="24.077450179s" totalImagesPullingTime="20.227508162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:36:39.077419914 +0000 UTC m=+94.178895368" watchObservedRunningTime="2026-09-16 14:36:39.077450179 +0000 UTC m=+94.178925632"
Sep 16 14:36:42.233454 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:42.233409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:42.329985 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:42.329914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:44.899713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:44.899679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:44.997779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:44.997744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:45.573634 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:45.573586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:45.746225 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:45.746195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:46.263991 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:46.263922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:46.430655 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:46.430617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:47.810718 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:47.810685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:48.054509 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:48.054477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:36:56.111670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:56.111632    2565 generic.go:356] "Generic (PLEG): container finished" podID="0d1c52d6-e464-4ead-ad7f-642bb908764a" containerID="e84b5df270e7b05f0e5b6c145abff57db111c47a46fd2826616544ff919878a9" exitCode=0
Sep 16 14:36:56.112258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:56.111711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf" event={"ID":"0d1c52d6-e464-4ead-ad7f-642bb908764a","Type":"ContainerDied","Data":"e84b5df270e7b05f0e5b6c145abff57db111c47a46fd2826616544ff919878a9"}
Sep 16 14:36:56.112258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:56.112181    2565 scope.go:117] "RemoveContainer" containerID="e84b5df270e7b05f0e5b6c145abff57db111c47a46fd2826616544ff919878a9"
Sep 16 14:36:57.117824 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:36:57.117786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-f55xf" event={"ID":"0d1c52d6-e464-4ead-ad7f-642bb908764a","Type":"ContainerStarted","Data":"05df3b0ec83c7f386e6bab659961573a681c12c40a3de61ca7e724ed5dd5dbb6"}
Sep 16 14:37:00.133854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:00.133823    2565 generic.go:356] "Generic (PLEG): container finished" podID="19c209c8-b20a-4dc8-aba9-d58efc443f30" containerID="1e5e9e3008e04858c545e9ee2c7e585f110f163c21763ce7223a5b256c19c686" exitCode=0
Sep 16 14:37:00.134174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:00.133899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fjrq7" event={"ID":"19c209c8-b20a-4dc8-aba9-d58efc443f30","Type":"ContainerDied","Data":"1e5e9e3008e04858c545e9ee2c7e585f110f163c21763ce7223a5b256c19c686"}
Sep 16 14:37:00.134222 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:00.134209    2565 scope.go:117] "RemoveContainer" containerID="1e5e9e3008e04858c545e9ee2c7e585f110f163c21763ce7223a5b256c19c686"
Sep 16 14:37:01.139932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:01.139901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-fjrq7" event={"ID":"19c209c8-b20a-4dc8-aba9-d58efc443f30","Type":"ContainerStarted","Data":"f4f250caf98e91ba78af05efc0bcadf173a14b96ad8b816c63407957958ccc94"}
Sep 16 14:37:03.456799 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.456746    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-766866855f-6jc4m" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerName="registry" containerID="cri-o://388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298" gracePeriod=30
Sep 16 14:37:03.719838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.719779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:37:03.763191 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763284    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763319    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlgbq\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token\") pod \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\" (UID: \"6447bcc1-21f2-4566-a05e-2c0ee50d76ac\") "
Sep 16 14:37:03.763966 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763897    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:03.763966 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.763910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:37:03.766072 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.766044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:03.766191 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.766166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq" (OuterVolumeSpecName: "kube-api-access-mlgbq") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "kube-api-access-mlgbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:03.766314 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.766269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:03.766488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.766464    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:37:03.766548 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.766489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:37:03.772738 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.772714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6447bcc1-21f2-4566-a05e-2c0ee50d76ac" (UID: "6447bcc1-21f2-4566-a05e-2c0ee50d76ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:37:03.864934 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.864910    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-installation-pull-secrets\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.864934    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-image-registry-private-configuration\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.864973    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-bound-sa-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.864985    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.864997    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-registry-certificates\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.865011    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-ca-trust-extracted\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.865024    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-trusted-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:03.865046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:03.865036    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlgbq\" (UniqueName: \"kubernetes.io/projected/6447bcc1-21f2-4566-a05e-2c0ee50d76ac-kube-api-access-mlgbq\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:37:04.152460 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.152433    2565 generic.go:356] "Generic (PLEG): container finished" podID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerID="388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298" exitCode=0
Sep 16 14:37:04.152567 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.152478    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-766866855f-6jc4m"
Sep 16 14:37:04.152567 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.152525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766866855f-6jc4m" event={"ID":"6447bcc1-21f2-4566-a05e-2c0ee50d76ac","Type":"ContainerDied","Data":"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"}
Sep 16 14:37:04.152678 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.152583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-766866855f-6jc4m" event={"ID":"6447bcc1-21f2-4566-a05e-2c0ee50d76ac","Type":"ContainerDied","Data":"0e6a6b198932ce1cbb7a8f3c7be511a65883da3bf32261613d7fae71979f277a"}
Sep 16 14:37:04.152678 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.152613    2565 scope.go:117] "RemoveContainer" containerID="388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"
Sep 16 14:37:04.161632 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.161616    2565 scope.go:117] "RemoveContainer" containerID="388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"
Sep 16 14:37:04.161904 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:37:04.161882    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298\": container with ID starting with 388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298 not found: ID does not exist" containerID="388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"
Sep 16 14:37:04.161989 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.161909    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298"} err="failed to get container status \"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298\": rpc error: code = NotFound desc = could not find container \"388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298\": container with ID starting with 388e346c7c11b60410be97455c63c2b81a2cba6fe2c73699e874ed74f1c09298 not found: ID does not exist"
Sep 16 14:37:04.174067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.174043    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:37:04.176704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.176683    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-766866855f-6jc4m"]
Sep 16 14:37:04.543257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.543227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:04.629442 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:04.629413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:05.157769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:05.157740    2565 generic.go:356] "Generic (PLEG): container finished" podID="309c2440-fe07-409e-ab6d-e682563fd4b3" containerID="aea12a3445b45b763537bdbbfe6943c5893061789ab2bed6a67d73cd31a39457" exitCode=0
Sep 16 14:37:05.157897 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:05.157815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555" event={"ID":"309c2440-fe07-409e-ab6d-e682563fd4b3","Type":"ContainerDied","Data":"aea12a3445b45b763537bdbbfe6943c5893061789ab2bed6a67d73cd31a39457"}
Sep 16 14:37:05.158198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:05.158178    2565 scope.go:117] "RemoveContainer" containerID="aea12a3445b45b763537bdbbfe6943c5893061789ab2bed6a67d73cd31a39457"
Sep 16 14:37:05.491125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:05.491066    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" path="/var/lib/kubelet/pods/6447bcc1-21f2-4566-a05e-2c0ee50d76ac/volumes"
Sep 16 14:37:06.164482 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:06.164447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-qt555" event={"ID":"309c2440-fe07-409e-ab6d-e682563fd4b3","Type":"ContainerStarted","Data":"e87e714110fa0e95004e41d129d6faabbfedf1868ddf8a402249b917d5952bf3"}
Sep 16 14:37:07.514329 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:07.514295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:07.634414 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:07.634385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:38.337512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:38.337468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:46.718791 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:46.718753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:47.125284 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:47.125246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:56.919135 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:56.919091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:57.019080 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:57.019046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:57.120025 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:57.119979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:57.646070 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:57.646032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:37:57.704206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:37:57.704178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:08.121512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:38:08.121467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:38:08.215160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:38:08.215129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:02.092743 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:02.092711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:02.155086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:02.155054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:08.332194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:08.332154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:14.055244 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:14.055197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:14.112366 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:14.112334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:14.604065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:14.604030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:14.911063 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:14.910983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:15.533415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:15.533380    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:15.585260 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:15.585232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:19.596214 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:19.596178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:19.690014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:19.689979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:25.246404 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:25.246363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:25.347273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:25.347237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:25.409423 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:25.409388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:39:49.303084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:39:49.303035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:03.385646 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:03.385608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:03.481383 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:03.481348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:05.305208 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:05.305178    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:40:05.309426 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:05.309400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:40:05.323901 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:05.323879    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 14:40:25.330363 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:25.330294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:27.463709 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:27.463655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.366610 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:29.366564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:29.471636 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:29.471598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:31.153963 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:31.153905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:31.346665 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:31.346630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:33.405990 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:33.405934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:33.779018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:33.778982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:36.123738 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:36.123701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:36.224176 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:36.224144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:39.757643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:39.757602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:39.854015 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:39.853972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:41.190077 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:41.190037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:41.999829 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:41.999799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:42.079600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:42.079559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:45.362519 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:45.362453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:45.462826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:45.462794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:40:47.782456 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:40:47.782415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:01.552268 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:01.552175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:01.667380 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:01.667348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.093237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.093205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.247819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.247790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.629793 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.629761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.743846 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.743813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:02.786806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.786781    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"]
Sep 16 14:41:02.787134 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.787120    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerName="registry"
Sep 16 14:41:02.787184 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.787136    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerName="registry"
Sep 16 14:41:02.787217 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.787191    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6447bcc1-21f2-4566-a05e-2c0ee50d76ac" containerName="registry"
Sep 16 14:41:02.790144 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.790129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:02.793132 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.793112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 14:41:02.809106 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.809084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 14:41:02.809209 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.809189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 14:41:02.809292 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.809276    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 14:41:02.827394 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.827374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2nhn5\""
Sep 16 14:41:02.836714 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.836692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"]
Sep 16 14:41:02.922447 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.922397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:02.922447 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.922422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:02.922571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.922452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:02.922571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.922478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:02.922571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:02.922529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2tp\" (UniqueName: \"kubernetes.io/projected/9d813516-f641-420d-a4af-b3c67c4595a6-kube-api-access-tj2tp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023179 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023179 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023179 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2tp\" (UniqueName: \"kubernetes.io/projected/9d813516-f641-420d-a4af-b3c67c4595a6-kube-api-access-tj2tp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.023554 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.023530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-manifests\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.025414 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.025391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d813516-f641-420d-a4af-b3c67c4595a6-tmp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.025587 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.025571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.025705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.025687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9d813516-f641-420d-a4af-b3c67c4595a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.048999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.048974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2tp\" (UniqueName: \"kubernetes.io/projected/9d813516-f641-420d-a4af-b3c67c4595a6-kube-api-access-tj2tp\") pod \"opendatahub-operator-controller-manager-846667779d-cvtsg\" (UID: \"9d813516-f641-420d-a4af-b3c67c4595a6\") " pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.100104 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.100084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:03.242037 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.241978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:03.397878 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.397853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"]
Sep 16 14:41:03.398632 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:41:03.398610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d813516_f641_420d_a4af_b3c67c4595a6.slice/crio-58f9237be848417b57029b32023047736eb172fe8fd5fe6713456aaf8a563fa9 WatchSource:0}: Error finding container 58f9237be848417b57029b32023047736eb172fe8fd5fe6713456aaf8a563fa9: Status 404 returned error can't find the container with id 58f9237be848417b57029b32023047736eb172fe8fd5fe6713456aaf8a563fa9
Sep 16 14:41:03.400378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.400362    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:41:03.404712 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.404681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:03.524706 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.524677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:03.648679 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.648656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:03.747251 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:03.747226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:04.104931 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:04.104903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg" event={"ID":"9d813516-f641-420d-a4af-b3c67c4595a6","Type":"ContainerStarted","Data":"58f9237be848417b57029b32023047736eb172fe8fd5fe6713456aaf8a563fa9"}
Sep 16 14:41:07.120113 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:07.120080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg" event={"ID":"9d813516-f641-420d-a4af-b3c67c4595a6","Type":"ContainerStarted","Data":"33e1f572b8f6265a1473b374b9d6733d48617a4ac066bb34a2911315a23b4317"}
Sep 16 14:41:08.126294 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:08.126260    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d813516-f641-420d-a4af-b3c67c4595a6" containerID="33e1f572b8f6265a1473b374b9d6733d48617a4ac066bb34a2911315a23b4317" exitCode=0
Sep 16 14:41:08.126671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:08.126312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg" event={"ID":"9d813516-f641-420d-a4af-b3c67c4595a6","Type":"ContainerDied","Data":"33e1f572b8f6265a1473b374b9d6733d48617a4ac066bb34a2911315a23b4317"}
Sep 16 14:41:10.137731 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:10.137700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg" event={"ID":"9d813516-f641-420d-a4af-b3c67c4595a6","Type":"ContainerStarted","Data":"58a016c34835ca494105a9eacb0d542f977724c3abf43c4bff5fb7ac41625e3e"}
Sep 16 14:41:10.138217 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:10.137794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:10.169142 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:10.166700    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg" podStartSLOduration=2.937658722 podStartE2EDuration="8.166681335s" totalImagesPullingTime="4.22571726s" totalInitContainerRuntime="1.003305353s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:10.162195556 +0000 UTC m=+365.263671000" watchObservedRunningTime="2026-09-16 14:41:10.166681335 +0000 UTC m=+365.268156787"
Sep 16 14:41:14.282276 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:14.282237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:14.382204 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:14.382149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:21.143997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:21.143959    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-846667779d-cvtsg"
Sep 16 14:41:23.454090 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.454051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:23.573705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.573671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:23.826181 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.826153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:23.862222 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.862198    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"]
Sep 16 14:41:23.875856 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.875827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:23.879532 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.879511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 14:41:23.879643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.879517    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 14:41:23.882822 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.882695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"]
Sep 16 14:41:23.969081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.969056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba09fcf5-28ce-40e2-8621-6d576cd47971-tmp\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:23.969177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.969119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba09fcf5-28ce-40e2-8621-6d576cd47971-tls-certs\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:23.969177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:23.969142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98vqd\" (UniqueName: \"kubernetes.io/projected/ba09fcf5-28ce-40e2-8621-6d576cd47971-kube-api-access-98vqd\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.058107 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.058074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:24.070068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.070045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba09fcf5-28ce-40e2-8621-6d576cd47971-tls-certs\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.070160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.070071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98vqd\" (UniqueName: \"kubernetes.io/projected/ba09fcf5-28ce-40e2-8621-6d576cd47971-kube-api-access-98vqd\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.070160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.070109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba09fcf5-28ce-40e2-8621-6d576cd47971-tmp\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.072140 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.072121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba09fcf5-28ce-40e2-8621-6d576cd47971-tmp\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.072395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.072375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba09fcf5-28ce-40e2-8621-6d576cd47971-tls-certs\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.079506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.079458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98vqd\" (UniqueName: \"kubernetes.io/projected/ba09fcf5-28ce-40e2-8621-6d576cd47971-kube-api-access-98vqd\") pod \"kube-auth-proxy-7d79898bc9-vqnp5\" (UID: \"ba09fcf5-28ce-40e2-8621-6d576cd47971\") " pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.186562 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.186545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"
Sep 16 14:41:24.461630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:24.461564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5"]
Sep 16 14:41:24.465022 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:41:24.464998    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba09fcf5_28ce_40e2_8621_6d576cd47971.slice/crio-841d623560ba2feddcbd4e9d8b24ffe05ada5ba32c07cfae5f77b625f002c81b WatchSource:0}: Error finding container 841d623560ba2feddcbd4e9d8b24ffe05ada5ba32c07cfae5f77b625f002c81b: Status 404 returned error can't find the container with id 841d623560ba2feddcbd4e9d8b24ffe05ada5ba32c07cfae5f77b625f002c81b
Sep 16 14:41:25.209718 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.209675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5" event={"ID":"ba09fcf5-28ce-40e2-8621-6d576cd47971","Type":"ContainerStarted","Data":"841d623560ba2feddcbd4e9d8b24ffe05ada5ba32c07cfae5f77b625f002c81b"}
Sep 16 14:41:25.324909 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.324877    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:25.328609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.328582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.329220 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.329131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.331182 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.331159    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:41:25.331395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.331378    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 14:41:25.331732 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.331713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 14:41:25.332297 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.332217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 14:41:25.332297 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.332291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ffr5t\""
Sep 16 14:41:25.344444 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.344420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:25.380852 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.380825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mwl\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.380876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.380909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.380986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.381041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381300 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.381083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.381300 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.381142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.395387 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.395358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:25.481894 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.481818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.481894 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.481874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.482421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.481922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.482421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.481999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.482421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.482030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mwl\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.482421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.482063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.482421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.482090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.483046 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.482676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.484851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.484823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.485035 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.484982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.485394 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.485353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.485521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.485491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.491950 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.491922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.492356 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.492333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mwl\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl\") pod \"istiod-openshift-gateway-7b7995d5cd-shxpm\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.640806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.640778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:25.945109 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:25.944827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:26.535957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:26.535911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:27.003352 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:41:27.003323    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571a0dc8_7bdc_446a_b0e2_332adcf074d9.slice/crio-afc360348e576aaffd2d08ce104889a431fc6987e3c56ffea22f055be60309ab WatchSource:0}: Error finding container afc360348e576aaffd2d08ce104889a431fc6987e3c56ffea22f055be60309ab: Status 404 returned error can't find the container with id afc360348e576aaffd2d08ce104889a431fc6987e3c56ffea22f055be60309ab
Sep 16 14:41:27.221169 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:27.221131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5" event={"ID":"ba09fcf5-28ce-40e2-8621-6d576cd47971","Type":"ContainerStarted","Data":"f50b973a65ed598f8300554e1e44faa2f5aea35fa271414b44d2cfe5f3ca814a"}
Sep 16 14:41:27.222388 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:27.222365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" event={"ID":"571a0dc8-7bdc-446a-b0e2-332adcf074d9","Type":"ContainerStarted","Data":"afc360348e576aaffd2d08ce104889a431fc6987e3c56ffea22f055be60309ab"}
Sep 16 14:41:27.243502 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:27.243460    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5" podStartSLOduration=1.652525189 podStartE2EDuration="4.243448267s" totalImagesPullingTime="2.590923078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:27.242044641 +0000 UTC m=+382.343520094" watchObservedRunningTime="2026-09-16 14:41:27.243448267 +0000 UTC m=+382.344923719"
Sep 16 14:41:30.729288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:30.729249    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:41:30.729555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:30.729315    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:41:31.199321 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.199231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:31.243719 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.243689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" event={"ID":"571a0dc8-7bdc-446a-b0e2-332adcf074d9","Type":"ContainerStarted","Data":"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"}
Sep 16 14:41:31.243910 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.243895    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:31.245736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.245710    2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-shxpm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:41:31.245850 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.245755    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:41:31.270643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.270577    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" podStartSLOduration=2.547040979 podStartE2EDuration="6.270562377s" totalImagesPullingTime="3.723521398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:31.269452612 +0000 UTC m=+386.370928066" watchObservedRunningTime="2026-09-16 14:41:31.270562377 +0000 UTC m=+386.372037830"
Sep 16 14:41:31.280724 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.280697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:31.975918 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:31.975878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:32.068166 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.068108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:32.174014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.173977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:32.249043 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.249022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:32.282018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.281988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:32.694929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.694839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:32.770812 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:32.770782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:34.685475 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:34.685422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:34.777962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:34.777906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:34.877704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:34.877656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:35.044047 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:35.044012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:35.237209 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:35.237179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:35.603285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:35.603250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:43.193211 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:43.193179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:43.349158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:43.349128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:43.514586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:43.514556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:45.612277 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.612249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:45.845917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.845878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:45.846617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.846590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"]
Sep 16 14:41:45.851028 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.851011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:45.855352 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.855331    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t9smh\""
Sep 16 14:41:45.855458 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.855361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 14:41:45.892985 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.892922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"]
Sep 16 14:41:45.894260 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.894240    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"]
Sep 16 14:41:45.897442 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.897421    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:45.901332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.901310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 14:41:45.901431 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.901310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gszc7\""
Sep 16 14:41:45.920961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.920925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"]
Sep 16 14:41:45.945691 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.945669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-cert\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:45.945779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.945708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzw5t\" (UniqueName: \"kubernetes.io/projected/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-kube-api-access-tzw5t\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:45.993651 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:45.993627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:46.047017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.046993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzw5t\" (UniqueName: \"kubernetes.io/projected/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-kube-api-access-tzw5t\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:46.047096 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.047031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jhzv\" (UniqueName: \"kubernetes.io/projected/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-kube-api-access-5jhzv\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.047096 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.047078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-cert\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:46.047177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.047103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.049520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.049496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-cert\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:46.059570 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.059549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzw5t\" (UniqueName: \"kubernetes.io/projected/d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca-kube-api-access-tzw5t\") pod \"kserve-controller-manager-d6f4b65b8-8j7xp\" (UID: \"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:46.147630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.147570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.147630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.147618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jhzv\" (UniqueName: \"kubernetes.io/projected/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-kube-api-access-5jhzv\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.149736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.149710    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.157605 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.157586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jhzv\" (UniqueName: \"kubernetes.io/projected/8b9b8780-44dc-45a2-8b78-d7a77e7924a2-kube-api-access-5jhzv\") pod \"llmisvc-controller-manager-777c6bd7d5-fbjg2\" (UID: \"8b9b8780-44dc-45a2-8b78-d7a77e7924a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.161434 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.161413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:46.207150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.206986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:46.454007 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.453983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"]
Sep 16 14:41:46.456249 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:41:46.456223    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88d406b_b7ea_4f44_8a9a_f2c6af8a34ca.slice/crio-0f29c024748ddf10f8e086324f948fe901483ad57a00e719658a72d1107fa489 WatchSource:0}: Error finding container 0f29c024748ddf10f8e086324f948fe901483ad57a00e719658a72d1107fa489: Status 404 returned error can't find the container with id 0f29c024748ddf10f8e086324f948fe901483ad57a00e719658a72d1107fa489
Sep 16 14:41:46.519558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.519522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"]
Sep 16 14:41:46.521696 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:41:46.521672    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b9b8780_44dc_45a2_8b78_d7a77e7924a2.slice/crio-7ebcf24ee8291be221d019c9caf425c5774da2cd0386fe36fa4cd4b6ca8f92af WatchSource:0}: Error finding container 7ebcf24ee8291be221d019c9caf425c5774da2cd0386fe36fa4cd4b6ca8f92af: Status 404 returned error can't find the container with id 7ebcf24ee8291be221d019c9caf425c5774da2cd0386fe36fa4cd4b6ca8f92af
Sep 16 14:41:46.934760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:46.934736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:47.126558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:47.126532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:47.319106 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:47.319073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2" event={"ID":"8b9b8780-44dc-45a2-8b78-d7a77e7924a2","Type":"ContainerStarted","Data":"7ebcf24ee8291be221d019c9caf425c5774da2cd0386fe36fa4cd4b6ca8f92af"}
Sep 16 14:41:47.320483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:47.320447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp" event={"ID":"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca","Type":"ContainerStarted","Data":"0f29c024748ddf10f8e086324f948fe901483ad57a00e719658a72d1107fa489"}
Sep 16 14:41:48.919008 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:48.918963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:49.056661 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:49.056622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:41:49.846702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:49.846672    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:49.846850 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:49.846837    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerName="discovery" containerID="cri-o://74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7" gracePeriod=30
Sep 16 14:41:50.092588 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.092564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:50.184455 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184401    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184455 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184452    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9mwl\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.184639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.184550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig\") pod \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\" (UID: \"571a0dc8-7bdc-446a-b0e2-332adcf074d9\") "
Sep 16 14:41:50.186928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.185272    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:41:50.187084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.187057    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:50.187277 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.187254    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:50.187277 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.187261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs" (OuterVolumeSpecName: "local-certs") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:41:50.187432 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.187415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:50.187565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.187538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl" (OuterVolumeSpecName: "kube-api-access-t9mwl") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "kube-api-access-t9mwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:41:50.193372 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.193346    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts" (OuterVolumeSpecName: "cacerts") pod "571a0dc8-7bdc-446a-b0e2-332adcf074d9" (UID: "571a0dc8-7bdc-446a-b0e2-332adcf074d9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:41:50.285228 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285207    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-cacerts\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285245    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9mwl\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-kube-api-access-t9mwl\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285255    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285264    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-dns-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285273    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-csr-ca-configmap\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285281    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/571a0dc8-7bdc-446a-b0e2-332adcf074d9-istio-kubeconfig\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.285308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.285289    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/571a0dc8-7bdc-446a-b0e2-332adcf074d9-local-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:41:50.335383 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.335356    2565 generic.go:356] "Generic (PLEG): container finished" podID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerID="74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7" exitCode=0
Sep 16 14:41:50.335499 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.335420    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"
Sep 16 14:41:50.335499 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.335432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" event={"ID":"571a0dc8-7bdc-446a-b0e2-332adcf074d9","Type":"ContainerDied","Data":"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"}
Sep 16 14:41:50.335601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.335504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm" event={"ID":"571a0dc8-7bdc-446a-b0e2-332adcf074d9","Type":"ContainerDied","Data":"afc360348e576aaffd2d08ce104889a431fc6987e3c56ffea22f055be60309ab"}
Sep 16 14:41:50.335601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.335525    2565 scope.go:117] "RemoveContainer" containerID="74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"
Sep 16 14:41:50.337266 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.337236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2" event={"ID":"8b9b8780-44dc-45a2-8b78-d7a77e7924a2","Type":"ContainerStarted","Data":"aecf59779be6af602ef270c79d095180baacd69cb8950b3b07289fc2051d38d9"}
Sep 16 14:41:50.337368 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.337358    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:41:50.338898 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.338874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp" event={"ID":"d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca","Type":"ContainerStarted","Data":"45975fb5aa51d11872f367a8af18911957e451176a94deb2653020905ae24e40"}
Sep 16 14:41:50.339069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.339055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:41:50.344474 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.344305    2565 scope.go:117] "RemoveContainer" containerID="74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"
Sep 16 14:41:50.344608 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:41:50.344592    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7\": container with ID starting with 74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7 not found: ID does not exist" containerID="74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"
Sep 16 14:41:50.344644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.344615    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7"} err="failed to get container status \"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7\": rpc error: code = NotFound desc = could not find container \"74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7\": container with ID starting with 74847d62ddf6544b7ac47ca4ba625c4fe61029584266d101ca751881efc73dc7 not found: ID does not exist"
Sep 16 14:41:50.390660 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.390608    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp" podStartSLOduration=2.506809651 podStartE2EDuration="5.390591193s" totalImagesPullingTime="2.883781542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:50.390036499 +0000 UTC m=+405.491511964" watchObservedRunningTime="2026-09-16 14:41:50.390591193 +0000 UTC m=+405.492066646"
Sep 16 14:41:50.461069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.461007    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2" podStartSLOduration=2.626839438 podStartE2EDuration="5.460996459s" totalImagesPullingTime="2.834157021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:41:50.445160804 +0000 UTC m=+405.546636256" watchObservedRunningTime="2026-09-16 14:41:50.460996459 +0000 UTC m=+405.562471911"
Sep 16 14:41:50.493457 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.493433    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:50.510541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:50.510521    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm"]
Sep 16 14:41:51.487030 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:41:51.487001    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" path="/var/lib/kubelet/pods/571a0dc8-7bdc-446a-b0e2-332adcf074d9/volumes"
Sep 16 14:42:21.347844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:42:21.347807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fbjg2"
Sep 16 14:42:21.350764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:42:21.350733    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8j7xp"
Sep 16 14:42:55.880004 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:42:55.879970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:42:55.983404 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:42:55.983369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:16.707281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:16.707240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:24.195961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:24.195911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:26.243567 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.243531    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"]
Sep 16 14:43:26.244045 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.244025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerName="discovery"
Sep 16 14:43:26.244095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.244049    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerName="discovery"
Sep 16 14:43:26.244150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.244139    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="571a0dc8-7bdc-446a-b0e2-332adcf074d9" containerName="discovery"
Sep 16 14:43:26.247017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.247002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:26.249722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.249699    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 14:43:26.250737 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.250719    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 14:43:26.250872 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.250795    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fct2g\""
Sep 16 14:43:26.264099 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.264076    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"]
Sep 16 14:43:26.318988 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.318966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd2wv\" (UniqueName: \"kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv\") pod \"limitador-operator-controller-manager-74495c69f8-6plrr\" (UID: \"e7ac1555-2534-4916-bb27-282fff126f45\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:26.420063 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.420034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd2wv\" (UniqueName: \"kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv\") pod \"limitador-operator-controller-manager-74495c69f8-6plrr\" (UID: \"e7ac1555-2534-4916-bb27-282fff126f45\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:26.436529 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.436498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd2wv\" (UniqueName: \"kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv\") pod \"limitador-operator-controller-manager-74495c69f8-6plrr\" (UID: \"e7ac1555-2534-4916-bb27-282fff126f45\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:26.557240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.557210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:26.793518 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.793470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:26.829102 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:26.828925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"]
Sep 16 14:43:26.831264 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:26.831239    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ac1555_2534_4916_bb27_282fff126f45.slice/crio-05038621f625f12f3d5825d7e23cdb4d6bd6560180976b5fa9e050b5c2483e2c WatchSource:0}: Error finding container 05038621f625f12f3d5825d7e23cdb4d6bd6560180976b5fa9e050b5c2483e2c: Status 404 returned error can't find the container with id 05038621f625f12f3d5825d7e23cdb4d6bd6560180976b5fa9e050b5c2483e2c
Sep 16 14:43:27.185833 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:27.185752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:27.614586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:27.614545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:27.761164 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:27.761125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr" event={"ID":"e7ac1555-2534-4916-bb27-282fff126f45","Type":"ContainerStarted","Data":"05038621f625f12f3d5825d7e23cdb4d6bd6560180976b5fa9e050b5c2483e2c"}
Sep 16 14:43:30.448585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.448539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:30.575947 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.575912    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"]
Sep 16 14:43:30.579186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.579171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.584352 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.584326    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cqs5g\""
Sep 16 14:43:30.602092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.602070    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"]
Sep 16 14:43:30.657924 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.657897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l4t8\" (UniqueName: \"kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.658067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.657957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.758954 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.758914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l4t8\" (UniqueName: \"kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.759065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.758976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.759284 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.759269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.774828 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.774802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l4t8\" (UniqueName: \"kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8\") pod \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:30.776967 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.776927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr" event={"ID":"e7ac1555-2534-4916-bb27-282fff126f45","Type":"ContainerStarted","Data":"3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0"}
Sep 16 14:43:30.777080 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.777065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:30.798341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.798298    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr" podStartSLOduration=1.797216178 podStartE2EDuration="4.798285458s" totalImagesPullingTime="3.00106928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:30.797988729 +0000 UTC m=+505.899464182" watchObservedRunningTime="2026-09-16 14:43:30.798285458 +0000 UTC m=+505.899760911"
Sep 16 14:43:30.888480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:30.888454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:31.166319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:31.166245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"]
Sep 16 14:43:31.170535 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:31.170510    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46935540_39d2_4767_8536_abe8d2f157e9.slice/crio-51b6d424d25f0adc4cc42c9dd6fe4e427e0e7aae89bf54c739be2831331513f3 WatchSource:0}: Error finding container 51b6d424d25f0adc4cc42c9dd6fe4e427e0e7aae89bf54c739be2831331513f3: Status 404 returned error can't find the container with id 51b6d424d25f0adc4cc42c9dd6fe4e427e0e7aae89bf54c739be2831331513f3
Sep 16 14:43:31.217357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:31.217324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:31.525581 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:31.525548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:31.656914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:31.656883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:31.782898 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:31.782816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s" event={"ID":"46935540-39d2-4767-8536-abe8d2f157e9","Type":"ContainerStarted","Data":"51b6d424d25f0adc4cc42c9dd6fe4e427e0e7aae89bf54c739be2831331513f3"}
Sep 16 14:43:32.644953 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.644904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"]
Sep 16 14:43:32.648725 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.648696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:32.651265 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.651240    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 14:43:32.651405 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.651321    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qwlbf\""
Sep 16 14:43:32.658802 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.658774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"]
Sep 16 14:43:32.774848 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.774802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcj28\" (UniqueName: \"kubernetes.io/projected/3ddc8d75-ace4-4c33-8dd2-1abfeec2c700-kube-api-access-tcj28\") pod \"dns-operator-controller-manager-7b84cd7c9c-mnmfs\" (UID: \"3ddc8d75-ace4-4c33-8dd2-1abfeec2c700\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:32.789175 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.789099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:32.876240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.876198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj28\" (UniqueName: \"kubernetes.io/projected/3ddc8d75-ace4-4c33-8dd2-1abfeec2c700-kube-api-access-tcj28\") pod \"dns-operator-controller-manager-7b84cd7c9c-mnmfs\" (UID: \"3ddc8d75-ace4-4c33-8dd2-1abfeec2c700\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:32.890676 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.890642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcj28\" (UniqueName: \"kubernetes.io/projected/3ddc8d75-ace4-4c33-8dd2-1abfeec2c700-kube-api-access-tcj28\") pod \"dns-operator-controller-manager-7b84cd7c9c-mnmfs\" (UID: \"3ddc8d75-ace4-4c33-8dd2-1abfeec2c700\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:32.962454 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:32.962388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:33.104364 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:33.104319    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:33.255884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:33.255703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:33.256092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:33.256074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"]
Sep 16 14:43:33.260552 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:33.260524    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddc8d75_ace4_4c33_8dd2_1abfeec2c700.slice/crio-8d38e5f382cd6c446a2a3831855f5c86bc9175ab8eea83e012c6c19127f0a79e WatchSource:0}: Error finding container 8d38e5f382cd6c446a2a3831855f5c86bc9175ab8eea83e012c6c19127f0a79e: Status 404 returned error can't find the container with id 8d38e5f382cd6c446a2a3831855f5c86bc9175ab8eea83e012c6c19127f0a79e
Sep 16 14:43:33.395471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:33.395434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:33.797883 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:33.797850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs" event={"ID":"3ddc8d75-ace4-4c33-8dd2-1abfeec2c700","Type":"ContainerStarted","Data":"8d38e5f382cd6c446a2a3831855f5c86bc9175ab8eea83e012c6c19127f0a79e"}
Sep 16 14:43:34.466110 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:34.466057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:35.673589 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.673553    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f9c7m"]
Sep 16 14:43:35.677656 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.677635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:35.680695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.680662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-msxqx\""
Sep 16 14:43:35.691962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.691919    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f9c7m"]
Sep 16 14:43:35.801375 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.801340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2m6\" (UniqueName: \"kubernetes.io/projected/5f463ddf-22dd-48fd-a122-bb8fe64adbf7-kube-api-access-qs2m6\") pod \"authorino-operator-76b478bd78-f9c7m\" (UID: \"5f463ddf-22dd-48fd-a122-bb8fe64adbf7\") " pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:35.810998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.810966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s" event={"ID":"46935540-39d2-4767-8536-abe8d2f157e9","Type":"ContainerStarted","Data":"06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617"}
Sep 16 14:43:35.811110 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.811076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:35.835595 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.835551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s" podStartSLOduration=1.993645992 podStartE2EDuration="5.835538221s" totalImagesPullingTime="3.841892229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:35.833601012 +0000 UTC m=+510.935076465" watchObservedRunningTime="2026-09-16 14:43:35.835538221 +0000 UTC m=+510.937013674"
Sep 16 14:43:35.901895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.901871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2m6\" (UniqueName: \"kubernetes.io/projected/5f463ddf-22dd-48fd-a122-bb8fe64adbf7-kube-api-access-qs2m6\") pod \"authorino-operator-76b478bd78-f9c7m\" (UID: \"5f463ddf-22dd-48fd-a122-bb8fe64adbf7\") " pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:35.911508 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.911488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2m6\" (UniqueName: \"kubernetes.io/projected/5f463ddf-22dd-48fd-a122-bb8fe64adbf7-kube-api-access-qs2m6\") pod \"authorino-operator-76b478bd78-f9c7m\" (UID: \"5f463ddf-22dd-48fd-a122-bb8fe64adbf7\") " pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:35.989335 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:35.989262    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:36.264385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.264158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-f9c7m"]
Sep 16 14:43:36.266871 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:36.266843    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f463ddf_22dd_48fd_a122_bb8fe64adbf7.slice/crio-79e311757e8b9aab384267330206ab3dfae3218245d411ba8a223470f0a9ebdc WatchSource:0}: Error finding container 79e311757e8b9aab384267330206ab3dfae3218245d411ba8a223470f0a9ebdc: Status 404 returned error can't find the container with id 79e311757e8b9aab384267330206ab3dfae3218245d411ba8a223470f0a9ebdc
Sep 16 14:43:36.797273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.797241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:36.816350 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.816317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs" event={"ID":"3ddc8d75-ace4-4c33-8dd2-1abfeec2c700","Type":"ContainerStarted","Data":"9620d175ce994d9bf2f9629b540587bfba9ddcbc76bf421557a98bc90bedbdf9"}
Sep 16 14:43:36.816489 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.816470    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:36.817798 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.817764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m" event={"ID":"5f463ddf-22dd-48fd-a122-bb8fe64adbf7","Type":"ContainerStarted","Data":"79e311757e8b9aab384267330206ab3dfae3218245d411ba8a223470f0a9ebdc"}
Sep 16 14:43:36.837441 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.837377    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs" podStartSLOduration=2.238195677 podStartE2EDuration="4.837360124s" totalImagesPullingTime="2.599164447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:36.836919407 +0000 UTC m=+511.938394858" watchObservedRunningTime="2026-09-16 14:43:36.837360124 +0000 UTC m=+511.938835578"
Sep 16 14:43:36.898918 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:36.898878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:37.803235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:37.803203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:37.872240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:37.872212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:38.836233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:38.836199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m" event={"ID":"5f463ddf-22dd-48fd-a122-bb8fe64adbf7","Type":"ContainerStarted","Data":"371436c0757c59360a6f3c952d2ed6db6f23d1db2355064fcae58414f63ae034"}
Sep 16 14:43:38.836639 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:38.836327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:38.853702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:38.853650    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m" podStartSLOduration=2.311343107 podStartE2EDuration="3.85363268s" totalImagesPullingTime="1.542289573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:38.852912053 +0000 UTC m=+513.954387506" watchObservedRunningTime="2026-09-16 14:43:38.85363268 +0000 UTC m=+513.955108135"
Sep 16 14:43:40.808481 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:40.808443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:40.911926 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:40.911899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:41.183956 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:41.183869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:41.255491 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:41.255460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:41.389377 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:41.389346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:41.489318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:41.489233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:41.785370 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:41.785339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:46.327399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:46.327362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:46.413282 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:46.413253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:46.820334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:46.820301    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:46.890125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:46.890083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:46.992095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:46.992065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:47.827551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:47.827523    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-mnmfs"
Sep 16 14:43:48.421714 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.421682    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"]
Sep 16 14:43:48.425377 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.425360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.447067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.447043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"]
Sep 16 14:43:48.504102 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.504079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.504250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.504142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njvvv\" (UniqueName: \"kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.605268 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.605239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njvvv\" (UniqueName: \"kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.605407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.605320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.605713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.605695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.623370 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.623346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njvvv\" (UniqueName: \"kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.734641 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.734577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:48.956996 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.956962    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"]
Sep 16 14:43:48.957402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.957129    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s" podUID="46935540-39d2-4767-8536-abe8d2f157e9" containerName="manager" containerID="cri-o://06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617" gracePeriod=2
Sep 16 14:43:48.962519 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.962491    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"]
Sep 16 14:43:48.976631 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.976604    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"]
Sep 16 14:43:48.985170 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.985115    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:43:48.985474 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.985461    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46935540-39d2-4767-8536-abe8d2f157e9" containerName="manager"
Sep 16 14:43:48.985474 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.985474    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46935540-39d2-4767-8536-abe8d2f157e9" containerName="manager"
Sep 16 14:43:48.985589 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.985530    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="46935540-39d2-4767-8536-abe8d2f157e9" containerName="manager"
Sep 16 14:43:48.989999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.989861    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"]
Sep 16 14:43:48.990104 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:48.990038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:48.992470 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:48.992446    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="46935540-39d2-4767-8536-abe8d2f157e9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.001621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.001599    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:43:49.016683 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.005536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.018865 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.018833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:43:49.022925 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.022867    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"]
Sep 16 14:43:49.023157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.023130    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr" podUID="e7ac1555-2534-4916-bb27-282fff126f45" containerName="manager" containerID="cri-o://3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0" gracePeriod=2
Sep 16 14:43:49.025833 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.025810    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"]
Sep 16 14:43:49.030688 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.030558    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6plrr\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="e7ac1555-2534-4916-bb27-282fff126f45" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.031289 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.031265    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:43:49.032651 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.032476    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="46935540-39d2-4767-8536-abe8d2f157e9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.050469 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.050446    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"]
Sep 16 14:43:49.050802 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.050787    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ac1555-2534-4916-bb27-282fff126f45" containerName="manager"
Sep 16 14:43:49.050903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.050887    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ac1555-2534-4916-bb27-282fff126f45" containerName="manager"
Sep 16 14:43:49.051022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.050987    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ac1555-2534-4916-bb27-282fff126f45" containerName="manager"
Sep 16 14:43:49.053834 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.053814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.073238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.073216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"]
Sep 16 14:43:49.075433 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.075306    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6plrr\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="e7ac1555-2534-4916-bb27-282fff126f45" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.077459 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.077423    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="46935540-39d2-4767-8536-abe8d2f157e9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.116246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.116221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.116322 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.116263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwk7s\" (UniqueName: \"kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.116382 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.116344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.116430 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.116379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v82f\" (UniqueName: \"kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.120494 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.120468    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 16 14:43:49.120494 ip-10-0-136-124 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-mb59n_kuadrant-system_ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5_0(3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-mb59n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90" Netns:"/var/run/netns/0d496878-6f33-4a9a-bc0f-93e8f47a0e39" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-mb59n;K8S_POD_INFRA_CONTAINER_ID=3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90;K8S_POD_UID=ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-7978cbdfbc-mb59n in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-7978cbdfbc-mb59n in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-7978cbdfbc-mb59n" not found
Sep 16 14:43:49.120494 ip-10-0-136-124 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 14:43:49.120494 ip-10-0-136-124 kubenswrapper[2565]:  >
Sep 16 14:43:49.120648 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.120516    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 16 14:43:49.120648 ip-10-0-136-124 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-mb59n_kuadrant-system_ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5_0(3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-mb59n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90" Netns:"/var/run/netns/0d496878-6f33-4a9a-bc0f-93e8f47a0e39" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-mb59n;K8S_POD_INFRA_CONTAINER_ID=3a74048fe71bff5ab3d58e1919705c3e18a191fbca9ae2a75afee7b87a011c90;K8S_POD_UID=ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-7978cbdfbc-mb59n in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-7978cbdfbc-mb59n in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-7978cbdfbc-mb59n" not found
Sep 16 14:43:49.120648 ip-10-0-136-124 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 16 14:43:49.120648 ip-10-0-136-124 kubenswrapper[2565]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:49.217274 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.217417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217291    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v82f\" (UniqueName: \"kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.217417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.217417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlpcw\" (UniqueName: \"kubernetes.io/projected/87bdea90-382f-4dbd-9601-9bc1315dc1f9-kube-api-access-qlpcw\") pod \"limitador-operator-controller-manager-74495c69f8-2m4q7\" (UID: \"87bdea90-382f-4dbd-9601-9bc1315dc1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.217417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwk7s\" (UniqueName: \"kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.217687 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.217794 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.217774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.226709 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.226684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v82f\" (UniqueName: \"kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-w5rm9\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.226803 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.226765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwk7s\" (UniqueName: \"kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s\") pod \"kuadrant-operator-controller-manager-76f8f686bf-ljkj8\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.245065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.245043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.247486 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.247459    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6plrr\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="e7ac1555-2534-4916-bb27-282fff126f45" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.249693 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.249672    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="46935540-39d2-4767-8536-abe8d2f157e9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.251451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.251430    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.253822 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.253797    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-6plrr\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="e7ac1555-2534-4916-bb27-282fff126f45" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.256096 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.256077    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-hm88s\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="46935540-39d2-4767-8536-abe8d2f157e9" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.318131 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.318099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlpcw\" (UniqueName: \"kubernetes.io/projected/87bdea90-382f-4dbd-9601-9bc1315dc1f9-kube-api-access-qlpcw\") pod \"limitador-operator-controller-manager-74495c69f8-2m4q7\" (UID: \"87bdea90-382f-4dbd-9601-9bc1315dc1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.328055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.328031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlpcw\" (UniqueName: \"kubernetes.io/projected/87bdea90-382f-4dbd-9601-9bc1315dc1f9-kube-api-access-qlpcw\") pod \"limitador-operator-controller-manager-74495c69f8-2m4q7\" (UID: \"87bdea90-382f-4dbd-9601-9bc1315dc1f9\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.398130 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.398101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.405984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.405934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.410900 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.410881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.419101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.419077    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l4t8\" (UniqueName: \"kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8\") pod \"46935540-39d2-4767-8536-abe8d2f157e9\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") "
Sep 16 14:43:49.419194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.419121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd2wv\" (UniqueName: \"kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv\") pod \"e7ac1555-2534-4916-bb27-282fff126f45\" (UID: \"e7ac1555-2534-4916-bb27-282fff126f45\") "
Sep 16 14:43:49.419237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.419216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume\") pod \"46935540-39d2-4767-8536-abe8d2f157e9\" (UID: \"46935540-39d2-4767-8536-abe8d2f157e9\") "
Sep 16 14:43:49.419986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.419927    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46935540-39d2-4767-8536-abe8d2f157e9" (UID: "46935540-39d2-4767-8536-abe8d2f157e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:49.421609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.421579    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8" (OuterVolumeSpecName: "kube-api-access-7l4t8") pod "46935540-39d2-4767-8536-abe8d2f157e9" (UID: "46935540-39d2-4767-8536-abe8d2f157e9"). InnerVolumeSpecName "kube-api-access-7l4t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:49.421847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.421758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv" (OuterVolumeSpecName: "kube-api-access-nd2wv") pod "e7ac1555-2534-4916-bb27-282fff126f45" (UID: "e7ac1555-2534-4916-bb27-282fff126f45"). InnerVolumeSpecName "kube-api-access-nd2wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:49.488817 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.488761    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46935540-39d2-4767-8536-abe8d2f157e9" path="/var/lib/kubelet/pods/46935540-39d2-4767-8536-abe8d2f157e9/volumes"
Sep 16 14:43:49.489156 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.489141    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ac1555-2534-4916-bb27-282fff126f45" path="/var/lib/kubelet/pods/e7ac1555-2534-4916-bb27-282fff126f45/volumes"
Sep 16 14:43:49.520484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.520462    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l4t8\" (UniqueName: \"kubernetes.io/projected/46935540-39d2-4767-8536-abe8d2f157e9-kube-api-access-7l4t8\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:43:49.520484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.520484    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd2wv\" (UniqueName: \"kubernetes.io/projected/e7ac1555-2534-4916-bb27-282fff126f45-kube-api-access-nd2wv\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:43:49.520614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.520493    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46935540-39d2-4767-8536-abe8d2f157e9-extensions-socket-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:43:49.683494 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.683466    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:43:49.686247 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:49.686214    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod702e1987_3d33_40ec_8d44_05b2b67b93d1.slice/crio-9463431c5cbbbd85e1dbd6b503d254d25d1c98f1552eac2eb600089df5b7b718 WatchSource:0}: Error finding container 9463431c5cbbbd85e1dbd6b503d254d25d1c98f1552eac2eb600089df5b7b718: Status 404 returned error can't find the container with id 9463431c5cbbbd85e1dbd6b503d254d25d1c98f1552eac2eb600089df5b7b718
Sep 16 14:43:49.695599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.695576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:43:49.699461 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:49.699438    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb5afd1d_d931_4d77_a3b0_a92848131d8d.slice/crio-ce2c69add39ac9e43484b99671663775853e180dee7294b28f35c3239c64f719 WatchSource:0}: Error finding container ce2c69add39ac9e43484b99671663775853e180dee7294b28f35c3239c64f719: Status 404 returned error can't find the container with id ce2c69add39ac9e43484b99671663775853e180dee7294b28f35c3239c64f719
Sep 16 14:43:49.707869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.707847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"]
Sep 16 14:43:49.711828 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:43:49.711807    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bdea90_382f_4dbd_9601_9bc1315dc1f9.slice/crio-fca9dff492f5ffce96477f9b4fd74409989c45e74a32f5118fccdb9d6ce52b52 WatchSource:0}: Error finding container fca9dff492f5ffce96477f9b4fd74409989c45e74a32f5118fccdb9d6ce52b52: Status 404 returned error can't find the container with id fca9dff492f5ffce96477f9b4fd74409989c45e74a32f5118fccdb9d6ce52b52
Sep 16 14:43:49.843233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.843203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-f9c7m"
Sep 16 14:43:49.890975 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.890911    2565 generic.go:356] "Generic (PLEG): container finished" podID="46935540-39d2-4767-8536-abe8d2f157e9" containerID="06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617" exitCode=0
Sep 16 14:43:49.891152 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.890982    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-hm88s"
Sep 16 14:43:49.891152 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.890990    2565 scope.go:117] "RemoveContainer" containerID="06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617"
Sep 16 14:43:49.893485 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.893462    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" event={"ID":"702e1987-3d33-40ec-8d44-05b2b67b93d1","Type":"ContainerStarted","Data":"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"}
Sep 16 14:43:49.893622 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.893523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" event={"ID":"702e1987-3d33-40ec-8d44-05b2b67b93d1","Type":"ContainerStarted","Data":"9463431c5cbbbd85e1dbd6b503d254d25d1c98f1552eac2eb600089df5b7b718"}
Sep 16 14:43:49.893622 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.893554    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:43:49.895576 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.895539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7" event={"ID":"87bdea90-382f-4dbd-9601-9bc1315dc1f9","Type":"ContainerStarted","Data":"80b590a70bdb40df3075f5d48270da8ab942c7d1e38335040880fc34f508942b"}
Sep 16 14:43:49.895698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.895591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:43:49.895698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.895610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7" event={"ID":"87bdea90-382f-4dbd-9601-9bc1315dc1f9","Type":"ContainerStarted","Data":"fca9dff492f5ffce96477f9b4fd74409989c45e74a32f5118fccdb9d6ce52b52"}
Sep 16 14:43:49.897490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.897466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" event={"ID":"db5afd1d-d931-4d77-a3b0-a92848131d8d","Type":"ContainerStarted","Data":"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"}
Sep 16 14:43:49.897643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.897510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" event={"ID":"db5afd1d-d931-4d77-a3b0-a92848131d8d","Type":"ContainerStarted","Data":"ce2c69add39ac9e43484b99671663775853e180dee7294b28f35c3239c64f719"}
Sep 16 14:43:49.897643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.897576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:43:49.898917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.898898    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7ac1555-2534-4916-bb27-282fff126f45" containerID="3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0" exitCode=0
Sep 16 14:43:49.899017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.898933    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-6plrr"
Sep 16 14:43:49.899090 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.899067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:49.901965 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.901950    2565 scope.go:117] "RemoveContainer" containerID="06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617"
Sep 16 14:43:49.902336 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.902290    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617\": container with ID starting with 06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617 not found: ID does not exist" containerID="06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617"
Sep 16 14:43:49.902336 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.902320    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617"} err="failed to get container status \"06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617\": rpc error: code = NotFound desc = could not find container \"06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617\": container with ID starting with 06f5e0be90ef75141396f705b7530f7fc6cff48967ebf5ac831dcde5f1c4a617 not found: ID does not exist"
Sep 16 14:43:49.902491 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.902343    2565 scope.go:117] "RemoveContainer" containerID="3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0"
Sep 16 14:43:49.908574 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.908555    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:49.913036 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.913011    2565 scope.go:117] "RemoveContainer" containerID="3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0"
Sep 16 14:43:49.913504 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.913485    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0\": container with ID starting with 3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0 not found: ID does not exist" containerID="3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0"
Sep 16 14:43:49.913584 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.913513    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0"} err="failed to get container status \"3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0\": rpc error: code = NotFound desc = could not find container \"3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0\": container with ID starting with 3e6277fae7801ff42ab6ab04f074c8c07713a2d96428f629801ae830bc9424e0 not found: ID does not exist"
Sep 16 14:43:49.920361 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.920323    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" podStartSLOduration=1.9203124379999998 podStartE2EDuration="1.920312438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:49.919085662 +0000 UTC m=+525.020561114" watchObservedRunningTime="2026-09-16 14:43:49.920312438 +0000 UTC m=+525.021787938"
Sep 16 14:43:49.943060 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.943025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" podStartSLOduration=1.9430168079999999 podStartE2EDuration="1.943016808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:49.942321679 +0000 UTC m=+525.043797133" watchObservedRunningTime="2026-09-16 14:43:49.943016808 +0000 UTC m=+525.044492260"
Sep 16 14:43:49.959583 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:49.959545    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7" podStartSLOduration=0.959533667 podStartE2EDuration="959.533667ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:43:49.9592992 +0000 UTC m=+525.060774654" watchObservedRunningTime="2026-09-16 14:43:49.959533667 +0000 UTC m=+525.061009116"
Sep 16 14:43:49.961349 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:49.961325    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:50.025412 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.025387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njvvv\" (UniqueName: \"kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv\") pod \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") "
Sep 16 14:43:50.025528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.025423    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume\") pod \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\" (UID: \"ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5\") "
Sep 16 14:43:50.025748 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.025726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" (UID: "ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:43:50.027528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.027508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv" (OuterVolumeSpecName: "kube-api-access-njvvv") pod "ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" (UID: "ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5"). InnerVolumeSpecName "kube-api-access-njvvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:43:50.126841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.126814    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njvvv\" (UniqueName: \"kubernetes.io/projected/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-kube-api-access-njvvv\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:43:50.126841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.126839    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5-extensions-socket-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:43:50.906025 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:50.905923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:50.908706 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:50.908680    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:50.914012 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:43:50.913986    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-mb59n\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-mb59n"
Sep 16 14:43:51.487121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:51.487090    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5" path="/var/lib/kubelet/pods/ec2bf3ee-c392-4e1d-93e9-8d980b37e1d5/volumes"
Sep 16 14:43:53.442334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:53.442298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:53.541098 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:53.541065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:56.073421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:56.073386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:56.173534 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:56.173501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:59.860284 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:59.860198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:43:59.960896 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:43:59.960858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:00.062679 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.062643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:00.161199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.161118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:00.908109 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.908079    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:44:00.908451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.908243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:44:00.908451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.908292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-2m4q7"
Sep 16 14:44:00.989986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.989952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:44:00.990171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:00.990147    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" podUID="702e1987-3d33-40ec-8d44-05b2b67b93d1" containerName="manager" containerID="cri-o://9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743" gracePeriod=10
Sep 16 14:44:01.079178 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.079141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:01.176339 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.176240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:01.227769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.227749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:44:01.321415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.321368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume\") pod \"702e1987-3d33-40ec-8d44-05b2b67b93d1\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") "
Sep 16 14:44:01.321606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.321578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwk7s\" (UniqueName: \"kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s\") pod \"702e1987-3d33-40ec-8d44-05b2b67b93d1\" (UID: \"702e1987-3d33-40ec-8d44-05b2b67b93d1\") "
Sep 16 14:44:01.321895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.321860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "702e1987-3d33-40ec-8d44-05b2b67b93d1" (UID: "702e1987-3d33-40ec-8d44-05b2b67b93d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:44:01.322510 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.322476    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/702e1987-3d33-40ec-8d44-05b2b67b93d1-extensions-socket-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:44:01.323856 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.323835    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 14:44:01.323955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.323906    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s" (OuterVolumeSpecName: "kube-api-access-vwk7s") pod "702e1987-3d33-40ec-8d44-05b2b67b93d1" (UID: "702e1987-3d33-40ec-8d44-05b2b67b93d1"). InnerVolumeSpecName "kube-api-access-vwk7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:44:01.324218 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.324204    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="702e1987-3d33-40ec-8d44-05b2b67b93d1" containerName="manager"
Sep 16 14:44:01.324272 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.324219    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="702e1987-3d33-40ec-8d44-05b2b67b93d1" containerName="manager"
Sep 16 14:44:01.324326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.324301    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="702e1987-3d33-40ec-8d44-05b2b67b93d1" containerName="manager"
Sep 16 14:44:01.326311 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.326290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.342769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.342747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 14:44:01.423766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.423738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.423877 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.423790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m6dw\" (UniqueName: \"kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.424004 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.423880    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwk7s\" (UniqueName: \"kubernetes.io/projected/702e1987-3d33-40ec-8d44-05b2b67b93d1-kube-api-access-vwk7s\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:44:01.524205 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.524181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.524319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.524222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m6dw\" (UniqueName: \"kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.524523 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.524504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.533174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.533151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m6dw\" (UniqueName: \"kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw\") pod \"kuadrant-operator-controller-manager-5769f99d9f-ckmdf\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.638187 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.638158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:01.919670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.919602    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 14:44:01.922126 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:44:01.922102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a137f9e_693b_4353_b377_7917162886df.slice/crio-b67ca19e5ca0638abc38205ebcb517dc93fb2a6ceb21e94cbdf49af13cd3073a WatchSource:0}: Error finding container b67ca19e5ca0638abc38205ebcb517dc93fb2a6ceb21e94cbdf49af13cd3073a: Status 404 returned error can't find the container with id b67ca19e5ca0638abc38205ebcb517dc93fb2a6ceb21e94cbdf49af13cd3073a
Sep 16 14:44:01.967594 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.967570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" event={"ID":"5a137f9e-693b-4353-b377-7917162886df","Type":"ContainerStarted","Data":"b67ca19e5ca0638abc38205ebcb517dc93fb2a6ceb21e94cbdf49af13cd3073a"}
Sep 16 14:44:01.971962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.971845    2565 generic.go:356] "Generic (PLEG): container finished" podID="702e1987-3d33-40ec-8d44-05b2b67b93d1" containerID="9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743" exitCode=0
Sep 16 14:44:01.972070 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.971929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" event={"ID":"702e1987-3d33-40ec-8d44-05b2b67b93d1","Type":"ContainerDied","Data":"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"}
Sep 16 14:44:01.972070 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.972045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8" event={"ID":"702e1987-3d33-40ec-8d44-05b2b67b93d1","Type":"ContainerDied","Data":"9463431c5cbbbd85e1dbd6b503d254d25d1c98f1552eac2eb600089df5b7b718"}
Sep 16 14:44:01.972184 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.972081    2565 scope.go:117] "RemoveContainer" containerID="9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"
Sep 16 14:44:01.972976 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.972267    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"
Sep 16 14:44:01.981242 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.981223    2565 scope.go:117] "RemoveContainer" containerID="9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"
Sep 16 14:44:01.981502 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:44:01.981483    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743\": container with ID starting with 9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743 not found: ID does not exist" containerID="9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"
Sep 16 14:44:01.981545 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:01.981511    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743"} err="failed to get container status \"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743\": rpc error: code = NotFound desc = could not find container \"9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743\": container with ID starting with 9104045b07db231f941b747dcf270acac7a37eda37e11ca5f9bb3da322543743 not found: ID does not exist"
Sep 16 14:44:02.022448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:02.022426    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:44:02.027439 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:02.027419    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-ljkj8"]
Sep 16 14:44:02.978404 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:02.978368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" event={"ID":"5a137f9e-693b-4353-b377-7917162886df","Type":"ContainerStarted","Data":"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"}
Sep 16 14:44:02.978857 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:02.978426    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:03.001276 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:03.001232    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" podStartSLOduration=2.001216586 podStartE2EDuration="2.001216586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:44:02.999788713 +0000 UTC m=+538.101264166" watchObservedRunningTime="2026-09-16 14:44:03.001216586 +0000 UTC m=+538.102692055"
Sep 16 14:44:03.487199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:03.487165    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="702e1987-3d33-40ec-8d44-05b2b67b93d1" path="/var/lib/kubelet/pods/702e1987-3d33-40ec-8d44-05b2b67b93d1/volumes"
Sep 16 14:44:07.898287 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:07.898246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:08.003059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:08.003021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:13.986419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:13.986386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 14:44:14.049934 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.049901    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:44:14.050180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.050125    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" podUID="db5afd1d-d931-4d77-a3b0-a92848131d8d" containerName="manager" containerID="cri-o://0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c" gracePeriod=10
Sep 16 14:44:14.287021 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.286995    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:44:14.326216 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.326191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v82f\" (UniqueName: \"kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f\") pod \"db5afd1d-d931-4d77-a3b0-a92848131d8d\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") "
Sep 16 14:44:14.326345 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.326232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume\") pod \"db5afd1d-d931-4d77-a3b0-a92848131d8d\" (UID: \"db5afd1d-d931-4d77-a3b0-a92848131d8d\") "
Sep 16 14:44:14.326710 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.326682    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db5afd1d-d931-4d77-a3b0-a92848131d8d" (UID: "db5afd1d-d931-4d77-a3b0-a92848131d8d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:44:14.328195 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.328173    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f" (OuterVolumeSpecName: "kube-api-access-8v82f") pod "db5afd1d-d931-4d77-a3b0-a92848131d8d" (UID: "db5afd1d-d931-4d77-a3b0-a92848131d8d"). InnerVolumeSpecName "kube-api-access-8v82f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:44:14.426912 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.426884    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v82f\" (UniqueName: \"kubernetes.io/projected/db5afd1d-d931-4d77-a3b0-a92848131d8d-kube-api-access-8v82f\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:44:14.426912 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.426906    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db5afd1d-d931-4d77-a3b0-a92848131d8d-extensions-socket-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:44:14.456258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.456231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:14.556338 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:14.556260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:15.036997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.036960    2565 generic.go:356] "Generic (PLEG): container finished" podID="db5afd1d-d931-4d77-a3b0-a92848131d8d" containerID="0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c" exitCode=0
Sep 16 14:44:15.037381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.037012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" event={"ID":"db5afd1d-d931-4d77-a3b0-a92848131d8d","Type":"ContainerDied","Data":"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"}
Sep 16 14:44:15.037381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.037051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9" event={"ID":"db5afd1d-d931-4d77-a3b0-a92848131d8d","Type":"ContainerDied","Data":"ce2c69add39ac9e43484b99671663775853e180dee7294b28f35c3239c64f719"}
Sep 16 14:44:15.037381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.037071    2565 scope.go:117] "RemoveContainer" containerID="0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"
Sep 16 14:44:15.037381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.037016    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"
Sep 16 14:44:15.045413 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.045395    2565 scope.go:117] "RemoveContainer" containerID="0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"
Sep 16 14:44:15.045665 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:44:15.045646    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c\": container with ID starting with 0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c not found: ID does not exist" containerID="0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"
Sep 16 14:44:15.045714 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.045674    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c"} err="failed to get container status \"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c\": rpc error: code = NotFound desc = could not find container \"0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c\": container with ID starting with 0b613ed5176b6392ea0def18ccc2d2022a29f8df038a2d959670da9a3c5cbe6c not found: ID does not exist"
Sep 16 14:44:15.066306 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.066283    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:44:15.071135 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.071115    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-w5rm9"]
Sep 16 14:44:15.487181 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:15.487108    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5afd1d-d931-4d77-a3b0-a92848131d8d" path="/var/lib/kubelet/pods/db5afd1d-d931-4d77-a3b0-a92848131d8d/volumes"
Sep 16 14:44:17.515906 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:17.515861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:17.745443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:17.745407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:33.811073 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:33.811038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:33.914472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:33.914440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:33.977151 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:33.977110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:34.219988 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.219915    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:44:34.220287 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.220275    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5afd1d-d931-4d77-a3b0-a92848131d8d" containerName="manager"
Sep 16 14:44:34.220331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.220290    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5afd1d-d931-4d77-a3b0-a92848131d8d" containerName="manager"
Sep 16 14:44:34.220365 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.220343    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5afd1d-d931-4d77-a3b0-a92848131d8d" containerName="manager"
Sep 16 14:44:34.223420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.223398    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.225961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.225916    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 14:44:34.225961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.225933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xtdb2\""
Sep 16 14:44:34.236521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.236503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:44:34.264962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.264916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:44:34.296538 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.296510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd4pq\" (UniqueName: \"kubernetes.io/projected/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-kube-api-access-wd4pq\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.296653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.296553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-config-file\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.397205 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.397180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-config-file\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.397309 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.397269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4pq\" (UniqueName: \"kubernetes.io/projected/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-kube-api-access-wd4pq\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.397899 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.397877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-config-file\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.405478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.405452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd4pq\" (UniqueName: \"kubernetes.io/projected/f1d0833b-dee2-4fc7-b797-6ee45a24a3b8-kube-api-access-wd4pq\") pod \"limitador-limitador-84994f7ffc-wnrf4\" (UID: \"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.533017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.532993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:34.687202 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.687165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:34.786466 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.786397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:34.803150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:34.799954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:44:35.132769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:35.132685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4" event={"ID":"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8","Type":"ContainerStarted","Data":"860359db5326e05cc09b551e963f190bc3cedf6bd03e48452f83817fa97acea7"}
Sep 16 14:44:42.168890 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:42.168852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4" event={"ID":"f1d0833b-dee2-4fc7-b797-6ee45a24a3b8","Type":"ContainerStarted","Data":"bb1da95837edac30e033de3c7722a0b28711cb67125bb65d5e110f0eb30e7582"}
Sep 16 14:44:42.169301 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:42.168989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:42.187172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:42.187126    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4" podStartSLOduration=1.66552138 podStartE2EDuration="8.187112101s" totalImagesPullingTime="6.521590721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:44:42.186366395 +0000 UTC m=+577.287841861" watchObservedRunningTime="2026-09-16 14:44:42.187112101 +0000 UTC m=+577.288587564"
Sep 16 14:44:53.176222 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:53.176194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"
Sep 16 14:44:55.556068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:55.556030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:56.249819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:56.249769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:56.347208 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:56.347171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:44:57.082181 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:44:57.082149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:05.347691 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:05.347664    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:45:05.348226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:05.348071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:45:09.184550 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:09.184512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:09.833598 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:09.833559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:16.953043 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:16.952999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:17.053130 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:17.053089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:17.148722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:17.148692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:17.443069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:17.443034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:20.947545 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:20.947504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:21.052196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:21.052162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:38.421372 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:38.421290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:49.445967 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:49.445906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:51.379172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:51.379111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:51.469079 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:51.469047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:52.753332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:52.753295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:52.854238 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:52.854202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:53.152332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:53.152252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:53.471422 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:53.471346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:53.566757 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:53.566722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:45:53.727875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:45:53.727797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:46:05.139670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:05.139630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:05.327466 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:05.327424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:10.320647 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:10.320615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:10.388672 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:10.388636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:13.219200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.219151    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"]
Sep 16 14:46:13.222872 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.222851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.225511 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.225490    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 14:46:13.225615 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.225548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-znlj6\""
Sep 16 14:46:13.226752 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.226734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 16 14:46:13.226845 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.226782    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 14:46:13.231433 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.231413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"]
Sep 16 14:46:13.251148 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.251126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:13.299376 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.299506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hvsd\" (UniqueName: \"kubernetes.io/projected/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-kube-api-access-4hvsd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.299506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.299506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.299659 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.299659 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.299547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401126 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401269 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401269 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401349 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401387 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401431 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hvsd\" (UniqueName: \"kubernetes.io/projected/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-kube-api-access-4hvsd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401501 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.401721 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.401700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.403348 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.403323    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.403619 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.403602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.410638 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.410609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hvsd\" (UniqueName: \"kubernetes.io/projected/2788587b-dd68-41e1-9e76-9a4ea3e06c2c-kube-api-access-4hvsd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n\" (UID: \"2788587b-dd68-41e1-9e76-9a4ea3e06c2c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.534094 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.534068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:13.716187 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.716150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:46:13.806468 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.806443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"]
Sep 16 14:46:13.809284 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:46:13.809258    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2788587b_dd68_41e1_9e76_9a4ea3e06c2c.slice/crio-3c4087cbf890a028280f6368cda3420b82cb525f1355791e116816705fe6a996 WatchSource:0}: Error finding container 3c4087cbf890a028280f6368cda3420b82cb525f1355791e116816705fe6a996: Status 404 returned error can't find the container with id 3c4087cbf890a028280f6368cda3420b82cb525f1355791e116816705fe6a996
Sep 16 14:46:13.810658 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:13.810638    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:46:14.599637 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:14.599596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n" event={"ID":"2788587b-dd68-41e1-9e76-9a4ea3e06c2c","Type":"ContainerStarted","Data":"3c4087cbf890a028280f6368cda3420b82cb525f1355791e116816705fe6a996"}
Sep 16 14:46:15.605945 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:15.605914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n" event={"ID":"2788587b-dd68-41e1-9e76-9a4ea3e06c2c","Type":"ContainerStarted","Data":"09f4b0529e80a934ba7d3d42c54b87e2a19a06a59793a2ef5e1a2cb7d191cba6"}
Sep 16 14:46:15.624740 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:15.624693    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n" podStartSLOduration=1.236459247 podStartE2EDuration="2.624680894s" totalImagesPullingTime="1.388221647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:46:15.623871947 +0000 UTC m=+670.725347401" watchObservedRunningTime="2026-09-16 14:46:15.624680894 +0000 UTC m=+670.726156379"
Sep 16 14:46:21.475636 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:21.475603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:23.534167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:23.534126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:23.534556 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:23.534185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:23.546059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:23.546035    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:23.653700 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:23.653669    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n"
Sep 16 14:46:25.080283 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:25.080249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:28.467726 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:28.467680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:29.215755 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:29.215720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:46:41.652137 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:41.652100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:42.512069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:42.512031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:46:51.610365 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.610335    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"]
Sep 16 14:46:51.613714 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.613695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.616178 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.616160    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 14:46:51.624390 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.624367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"]
Sep 16 14:46:51.624979 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.624956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjc4r\" (UniqueName: \"kubernetes.io/projected/e641007c-31cd-41f6-8333-66c5db42c44c-kube-api-access-fjc4r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.625071 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.624988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.625071 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.625053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.625157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.625082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.625157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.625098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e641007c-31cd-41f6-8333-66c5db42c44c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.625157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.625129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.642087 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.642055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:46:51.725443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjc4r\" (UniqueName: \"kubernetes.io/projected/e641007c-31cd-41f6-8333-66c5db42c44c-kube-api-access-fjc4r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.725606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.725606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.725606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.725606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e641007c-31cd-41f6-8333-66c5db42c44c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.725606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.725571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.726058 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.726026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.726058 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.726033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.726211 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.726033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.727608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.727579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e641007c-31cd-41f6-8333-66c5db42c44c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.727887 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.727866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e641007c-31cd-41f6-8333-66c5db42c44c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.734021 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.734000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjc4r\" (UniqueName: \"kubernetes.io/projected/e641007c-31cd-41f6-8333-66c5db42c44c-kube-api-access-fjc4r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f9w5l\" (UID: \"e641007c-31cd-41f6-8333-66c5db42c44c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:51.924520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:51.924443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:46:52.198265 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:52.198179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"]
Sep 16 14:46:52.200508 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:46:52.200482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode641007c_31cd_41f6_8333_66c5db42c44c.slice/crio-2b10430f4c848030921e6ca0d20a025b0a94489079c86e8cfbe35fd68033a156 WatchSource:0}: Error finding container 2b10430f4c848030921e6ca0d20a025b0a94489079c86e8cfbe35fd68033a156: Status 404 returned error can't find the container with id 2b10430f4c848030921e6ca0d20a025b0a94489079c86e8cfbe35fd68033a156
Sep 16 14:46:52.788955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:52.788862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l" event={"ID":"e641007c-31cd-41f6-8333-66c5db42c44c","Type":"ContainerStarted","Data":"5c9c56502a3e5226f0ee8ebad988e218a85756b12a4833b9420c0d2338aebc21"}
Sep 16 14:46:52.788955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:52.788917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l" event={"ID":"e641007c-31cd-41f6-8333-66c5db42c44c","Type":"ContainerStarted","Data":"2b10430f4c848030921e6ca0d20a025b0a94489079c86e8cfbe35fd68033a156"}
Sep 16 14:46:52.806868 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:52.806819    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l" podStartSLOduration=1.5043903539999999 podStartE2EDuration="1.806803831s" totalImagesPullingTime="302.413477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:46:52.80576018 +0000 UTC m=+707.907235632" watchObservedRunningTime="2026-09-16 14:46:52.806803831 +0000 UTC m=+707.908279308"
Sep 16 14:46:52.818849 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:46:52.818816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:47:01.925243 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:01.925164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:47:01.925243 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:01.925223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:47:01.937317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:01.937293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:47:02.845958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:02.845906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f9w5l"
Sep 16 14:47:08.112173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:08.112137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:09.414873 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:09.414843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:47:23.878246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:23.878209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:25.517246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:25.517212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:47:38.551033 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:38.550987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:38.686546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:38.686476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:47:40.844068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:47:40.844038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:48:01.691232 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:48:01.691187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:06.506271 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:06.506230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:06.597302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:06.597265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:08.052449 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:08.052409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:08.163840 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:08.163807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.049171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.049134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.149336 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.149297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.257177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.257142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.464797 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.464709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.592013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.591979    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.736180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.736103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.830251 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.830216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:27.930247 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:27.930209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.531751 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:28.531713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.623389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:28.623357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:28.970643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:28.970560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:29.128758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.128725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7685-177561"]
Sep 16 14:49:29.132219 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.132197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:29.134700 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.134676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6cz7\""
Sep 16 14:49:29.140081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.140063    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-177561"]
Sep 16 14:49:29.252451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.252423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89ss8\" (UniqueName: \"kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8\") pod \"test-curl-7685-177561\" (UID: \"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7\") " pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:29.353215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.353182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89ss8\" (UniqueName: \"kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8\") pod \"test-curl-7685-177561\" (UID: \"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7\") " pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:29.361776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.361747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89ss8\" (UniqueName: \"kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8\") pod \"test-curl-7685-177561\" (UID: \"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7\") " pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:29.442007 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.441981    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:29.716753 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:29.716727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-177561"]
Sep 16 14:49:29.718447 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:29.718424    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ac6ff53_2fdc_43ed_9a6c_491abd4ef4c7.slice/crio-d34b5af5c56c83bc0d25df8101671fcdfa2082420151f21f79c56c6af5e1c1a1 WatchSource:0}: Error finding container d34b5af5c56c83bc0d25df8101671fcdfa2082420151f21f79c56c6af5e1c1a1: Status 404 returned error can't find the container with id d34b5af5c56c83bc0d25df8101671fcdfa2082420151f21f79c56c6af5e1c1a1
Sep 16 14:49:30.201773 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.201738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:30.342420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.342376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:30.484430 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.484348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:30.524648 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.524616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-177561" event={"ID":"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7","Type":"ContainerStarted","Data":"d34b5af5c56c83bc0d25df8101671fcdfa2082420151f21f79c56c6af5e1c1a1"}
Sep 16 14:49:30.718241 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.718202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:30.988617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:30.988583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:49:31.247865 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.247824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:31.344325 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.344285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:31.897512 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.897477    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 14:49:31.901045 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.901029    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:31.903348 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.903324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 14:49:31.903472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.903351    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-780e10-serving-cert\""
Sep 16 14:49:31.904452 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.904414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 14:49:31.904452 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.904426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 14:49:31.904616 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.904497    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2cp94\""
Sep 16 14:49:31.922196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.922163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 14:49:31.939847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.939818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:31.978681 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.978621    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:31.978809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.978694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:31.978809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.978735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:31.978809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:31.978751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvmsz\" (UniqueName: \"kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.022577 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.022539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:32.079916 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.079889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.080065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.079954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.080065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.079971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.080065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.079985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvmsz\" (UniqueName: \"kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.080065 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:32.080050    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-serving-cert: secret "maas-api-e2e-worker-w0-780e10-serving-cert" not found
Sep 16 14:49:32.080374 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:32.080123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls podName:292612df-614b-4a35-98ff-1b6caf014114 nodeName:}" failed. No retries permitted until 2026-09-16 14:49:32.580101542 +0000 UTC m=+867.681576983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls") pod "maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" (UID: "292612df-614b-4a35-98ff-1b6caf014114") : secret "maas-api-e2e-worker-w0-780e10-serving-cert" not found
Sep 16 14:49:32.080611 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.080587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.082600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.082574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.089200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.089164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvmsz\" (UniqueName: \"kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.186496 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.186412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:32.537204 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.537167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-177561" event={"ID":"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7","Type":"ContainerStarted","Data":"c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd"}
Sep 16 14:49:32.555458 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.555411    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7685-177561" podStartSLOduration=1.373584924 podStartE2EDuration="3.555395562s" totalImagesPullingTime="2.181810638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:32.554536615 +0000 UTC m=+867.656012070" watchObservedRunningTime="2026-09-16 14:49:32.555395562 +0000 UTC m=+867.656871015"
Sep 16 14:49:32.566509 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.566481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:32.584897 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.584750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.587414 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.587389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") pod \"maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:32.659421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.659387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:32.812210 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:32.812137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:33.086742 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.086716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 14:49:33.088698 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:33.088657    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292612df_614b_4a35_98ff_1b6caf014114.slice/crio-429a0630c60f85346be1408663ce3664c2c6a8de47787bd4091784dd5d7dc03f WatchSource:0}: Error finding container 429a0630c60f85346be1408663ce3664c2c6a8de47787bd4091784dd5d7dc03f: Status 404 returned error can't find the container with id 429a0630c60f85346be1408663ce3664c2c6a8de47787bd4091784dd5d7dc03f
Sep 16 14:49:33.156192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.156148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:33.170654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.170625    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7685-177561"]
Sep 16 14:49:33.174389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.174363    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7685-177561"]
Sep 16 14:49:33.292227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.292197    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7685-16e7a2"]
Sep 16 14:49:33.292578 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.292566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" containerName="test-curl-7685-177561"
Sep 16 14:49:33.292625 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.292580    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" containerName="test-curl-7685-177561"
Sep 16 14:49:33.292659 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.292644    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" containerName="test-curl-7685-177561"
Sep 16 14:49:33.296897 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.296879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:33.301758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.301729    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-16e7a2"]
Sep 16 14:49:33.391504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.391436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfq6b\" (UniqueName: \"kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b\") pod \"test-curl-7685-16e7a2\" (UID: \"1d4c6635-4196-4449-8609-1eebd7e35fbb\") " pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:33.492479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.492448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfq6b\" (UniqueName: \"kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b\") pod \"test-curl-7685-16e7a2\" (UID: \"1d4c6635-4196-4449-8609-1eebd7e35fbb\") " pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:33.504642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.504606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfq6b\" (UniqueName: \"kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b\") pod \"test-curl-7685-16e7a2\" (UID: \"1d4c6635-4196-4449-8609-1eebd7e35fbb\") " pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:33.543235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.543202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" event={"ID":"292612df-614b-4a35-98ff-1b6caf014114","Type":"ContainerStarted","Data":"429a0630c60f85346be1408663ce3664c2c6a8de47787bd4091784dd5d7dc03f"}
Sep 16 14:49:33.543392 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:33.543360    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7685-177561" container="test-curl-7685-177561"
Sep 16 14:49:33.607996 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.607964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:33.830473 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.830430    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:49:33.837605 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.837579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.846731 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.845627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-78e52a-serving-cert\""
Sep 16 14:49:33.847629 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.847572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:49:33.871319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.871063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:33.886407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.885954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7685-16e7a2"]
Sep 16 14:49:33.888893 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:33.888863    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4c6635_4196_4449_8609_1eebd7e35fbb.slice/crio-e75985af0ff2f909a3023f4b46255e6a1e8aef280d736f03dc2a26194b3091b4 WatchSource:0}: Error finding container e75985af0ff2f909a3023f4b46255e6a1e8aef280d736f03dc2a26194b3091b4: Status 404 returned error can't find the container with id e75985af0ff2f909a3023f4b46255e6a1e8aef280d736f03dc2a26194b3091b4
Sep 16 14:49:33.896053 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.896024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7f8b\" (UniqueName: \"kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.896153 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.896107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.896214 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.896164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.896268 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.896227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.933459 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.933426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:33.997928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.997898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7f8b\" (UniqueName: \"kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.998070 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.997980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.998171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.998147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.998260 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.998218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:33.998889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:33.998863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:34.001176 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.001133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:34.001263 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.001192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:34.007094 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.007069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7f8b\" (UniqueName: \"kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b\") pod \"maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:34.036291 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.036262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:34.169583 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.169424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:34.355841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.355795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:34.456959 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.456895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:49:34.462826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.462755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:34.551212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.551175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-16e7a2" event={"ID":"1d4c6635-4196-4449-8609-1eebd7e35fbb","Type":"ContainerStarted","Data":"3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24"}
Sep 16 14:49:34.551379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.551222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7685-16e7a2" event={"ID":"1d4c6635-4196-4449-8609-1eebd7e35fbb","Type":"ContainerStarted","Data":"e75985af0ff2f909a3023f4b46255e6a1e8aef280d736f03dc2a26194b3091b4"}
Sep 16 14:49:34.551379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.551232    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7685-177561" podUID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" containerName="test-curl-7685-177561" containerID="cri-o://c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd" gracePeriod=2
Sep 16 14:49:34.566738 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:34.566677    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7685-16e7a2" podStartSLOduration=1.566656553 podStartE2EDuration="1.566656553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:34.565751438 +0000 UTC m=+869.667226903" watchObservedRunningTime="2026-09-16 14:49:34.566656553 +0000 UTC m=+869.668132006"
Sep 16 14:49:35.043297 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.043247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.144520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.144483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.181326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.181289    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7685-16e7a2"]
Sep 16 14:49:35.184421 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.184392    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7685-16e7a2"]
Sep 16 14:49:35.244698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.244660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.542117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.542084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.542561 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:35.542532    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0865420d_184f_428d_946f_44379d8a798a.slice/crio-78cec0926eec9624e2d70efe373c547db72d3f9c2b09190305d11c137d862fb3 WatchSource:0}: Error finding container 78cec0926eec9624e2d70efe373c547db72d3f9c2b09190305d11c137d862fb3: Status 404 returned error can't find the container with id 78cec0926eec9624e2d70efe373c547db72d3f9c2b09190305d11c137d862fb3
Sep 16 14:49:35.559092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.559069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" event={"ID":"0865420d-184f-428d-946f-44379d8a798a","Type":"ContainerStarted","Data":"78cec0926eec9624e2d70efe373c547db72d3f9c2b09190305d11c137d862fb3"}
Sep 16 14:49:35.559247 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:35.559229    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7685-16e7a2" container="test-curl-7685-16e7a2"
Sep 16 14:49:35.614186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.614163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.688827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.688796    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 14:49:35.689250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.689233    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4c6635-4196-4449-8609-1eebd7e35fbb" containerName="test-curl-7685-16e7a2"
Sep 16 14:49:35.689339 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.689252    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4c6635-4196-4449-8609-1eebd7e35fbb" containerName="test-curl-7685-16e7a2"
Sep 16 14:49:35.689445 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.689376    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4c6635-4196-4449-8609-1eebd7e35fbb" containerName="test-curl-7685-16e7a2"
Sep 16 14:49:35.692487 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.692467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.695085 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.695052    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-e33b3f\""
Sep 16 14:49:35.695199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.695163    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-e33b3f-dockercfg-djpwp\""
Sep 16 14:49:35.704905 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.704884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 14:49:35.722704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.722669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:35.817341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.817262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tr55\" (UniqueName: \"kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.817341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.817311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.918830 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.918796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tr55\" (UniqueName: \"kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.919040 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.918855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.919585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.919558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:35.933354 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:35.933327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tr55\" (UniqueName: \"kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55\") pod \"payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:36.004085 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.004060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:36.071858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.071695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:36.162385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.162354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:36.260614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.260571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:36.294798 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.294774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 14:49:36.296687 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:36.296664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6952f7b8_0e9d_4200_b48b_e8f9210145f3.slice/crio-5f1208f5490789386f72835d9e59fd56ce48935cca275c0ee24a81bdaca0d48d WatchSource:0}: Error finding container 5f1208f5490789386f72835d9e59fd56ce48935cca275c0ee24a81bdaca0d48d: Status 404 returned error can't find the container with id 5f1208f5490789386f72835d9e59fd56ce48935cca275c0ee24a81bdaca0d48d
Sep 16 14:49:36.361404 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.361329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:36.565301 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.565275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" event={"ID":"292612df-614b-4a35-98ff-1b6caf014114","Type":"ContainerStarted","Data":"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"}
Sep 16 14:49:36.565383 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.565367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:36.566713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.566618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" event={"ID":"6952f7b8-0e9d-4200-b48b-e8f9210145f3","Type":"ContainerStarted","Data":"5f1208f5490789386f72835d9e59fd56ce48935cca275c0ee24a81bdaca0d48d"}
Sep 16 14:49:36.568196 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.568176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" event={"ID":"0865420d-184f-428d-946f-44379d8a798a","Type":"ContainerStarted","Data":"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"}
Sep 16 14:49:36.568288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.568257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:36.568360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.568343    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7685-16e7a2" podUID="1d4c6635-4196-4449-8609-1eebd7e35fbb" containerName="test-curl-7685-16e7a2" containerID="cri-o://3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24" gracePeriod=2
Sep 16 14:49:36.641376 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.641283    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" podStartSLOduration=3.126629468 podStartE2EDuration="5.641265924s" totalImagesPullingTime="2.514636456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:36.629211115 +0000 UTC m=+871.730686568" watchObservedRunningTime="2026-09-16 14:49:36.641265924 +0000 UTC m=+871.742741376"
Sep 16 14:49:36.642164 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.642126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:36.684308 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.684257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" podStartSLOduration=3.239446269 podStartE2EDuration="3.684241683s" totalImagesPullingTime="444.795414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:36.682652865 +0000 UTC m=+871.784128318" watchObservedRunningTime="2026-09-16 14:49:36.684241683 +0000 UTC m=+871.785717135"
Sep 16 14:49:36.749235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.749215    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:36.828452 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.828425    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89ss8\" (UniqueName: \"kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8\") pod \"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7\" (UID: \"4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7\") "
Sep 16 14:49:36.830442 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.830417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8" (OuterVolumeSpecName: "kube-api-access-89ss8") pod "4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" (UID: "4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7"). InnerVolumeSpecName "kube-api-access-89ss8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:36.930141 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:36.930071    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89ss8\" (UniqueName: \"kubernetes.io/projected/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7-kube-api-access-89ss8\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:49:37.002548 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.002485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:37.369684 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.369651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:37.487175 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.487140    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" path="/var/lib/kubelet/pods/4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7/volumes"
Sep 16 14:49:37.519082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.519052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:37.574614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.574567    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ac6ff53-2fdc-43ed-9a6c-491abd4ef4c7" containerID="c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd" exitCode=137
Sep 16 14:49:37.574614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.574613    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-177561"
Sep 16 14:49:37.574818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.574622    2565 scope.go:117] "RemoveContainer" containerID="c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd"
Sep 16 14:49:37.582930 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.582906    2565 scope.go:117] "RemoveContainer" containerID="c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd"
Sep 16 14:49:37.583205 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:37.583186    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd\": container with ID starting with c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd not found: ID does not exist" containerID="c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd"
Sep 16 14:49:37.583259 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:37.583215    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd"} err="failed to get container status \"c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd\": rpc error: code = NotFound desc = could not find container \"c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd\": container with ID starting with c0d4e93a7cfcdbf0d95da725a5e2063ed70328c5f70323850255af6a72b6addd not found: ID does not exist"
Sep 16 14:49:38.404203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:38.404168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:38.746148 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:38.746123    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:38.846201 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:38.846167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfq6b\" (UniqueName: \"kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b\") pod \"1d4c6635-4196-4449-8609-1eebd7e35fbb\" (UID: \"1d4c6635-4196-4449-8609-1eebd7e35fbb\") "
Sep 16 14:49:38.848802 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:38.848775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b" (OuterVolumeSpecName: "kube-api-access-rfq6b") pod "1d4c6635-4196-4449-8609-1eebd7e35fbb" (UID: "1d4c6635-4196-4449-8609-1eebd7e35fbb"). InnerVolumeSpecName "kube-api-access-rfq6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:49:38.948083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:38.947994    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfq6b\" (UniqueName: \"kubernetes.io/projected/1d4c6635-4196-4449-8609-1eebd7e35fbb-kube-api-access-rfq6b\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:49:39.253188 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.253125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.388342 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.388302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.474463 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.474430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:39.488335 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.488307    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4c6635-4196-4449-8609-1eebd7e35fbb" path="/var/lib/kubelet/pods/1d4c6635-4196-4449-8609-1eebd7e35fbb/volumes"
Sep 16 14:49:39.594726 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.594646    2565 generic.go:356] "Generic (PLEG): container finished" podID="1d4c6635-4196-4449-8609-1eebd7e35fbb" containerID="3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24" exitCode=137
Sep 16 14:49:39.594726 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.594684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7685-16e7a2"
Sep 16 14:49:39.594961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.594745    2565 scope.go:117] "RemoveContainer" containerID="3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24"
Sep 16 14:49:39.896970 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:39.896872    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:40.115715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:40.115676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:40.471207 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:40.471161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:40.488921 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:40.488755    2565 scope.go:117] "RemoveContainer" containerID="3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24"
Sep 16 14:49:40.489160 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:40.489108    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24\": container with ID starting with 3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24 not found: ID does not exist" containerID="3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24"
Sep 16 14:49:40.489160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:40.489134    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24"} err="failed to get container status \"3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24\": rpc error: code = NotFound desc = could not find container \"3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24\": container with ID starting with 3d4795576df5d6f4f02f603631cbc5efde67f979473545cf1785bd678acc7d24 not found: ID does not exist"
Sep 16 14:49:41.609518 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:41.609484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" event={"ID":"6952f7b8-0e9d-4200-b48b-e8f9210145f3","Type":"ContainerStarted","Data":"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"}
Sep 16 14:49:41.609912 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:41.609584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:41.632101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:41.632049    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" podStartSLOduration=2.392911523 podStartE2EDuration="6.632030852s" totalImagesPullingTime="4.239119329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:41.629542111 +0000 UTC m=+876.731017564" watchObservedRunningTime="2026-09-16 14:49:41.632030852 +0000 UTC m=+876.733506306"
Sep 16 14:49:41.703633 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:41.703599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:42.523656 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.523623    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:49:42.527369 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.527349    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.531377 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.531353    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0252b3a9-serving-cert\""
Sep 16 14:49:42.547285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.547251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:49:42.563843 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.563801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:42.581437 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.581386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:49:42.581749 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.581724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.581875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.581792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 14:49:42.581875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.581815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4sd\" (UniqueName: \"kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.582017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.582001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.582204 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.582171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.663562 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.663521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:42.683875 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.683840    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.684034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.683891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.684092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.684044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4sd\" (UniqueName: \"kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.684092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.684075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.684512 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:42.684494    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-serving-cert: secret "maas-api-e2e-ait-0252b3a9-serving-cert" not found
Sep 16 14:49:42.686252 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.685517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.686383 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:42.686258    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls podName:142f2aed-6513-414f-8db8-9661d59eec6b nodeName:}" failed. No retries permitted until 2026-09-16 14:49:43.186238758 +0000 UTC m=+878.287714217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls") pod "maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" (UID: "142f2aed-6513-414f-8db8-9661d59eec6b") : secret "maas-api-e2e-ait-0252b3a9-serving-cert" not found
Sep 16 14:49:42.687257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.687237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:42.693305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:42.693278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4sd\" (UniqueName: \"kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:43.034700 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.034662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:43.115431 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.115394    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:49:43.156750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.156719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:43.188034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.188004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:43.190504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.190482    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") pod \"maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:43.259602 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.259571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:43.447225 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.447154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:43.722581 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.722553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:49:43.724962 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:43.724910    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142f2aed_6513_414f_8db8_9661d59eec6b.slice/crio-1d85671d426d207684f48dc28f99ab44cd7cae142fa22014039e7fd3bea2e903 WatchSource:0}: Error finding container 1d85671d426d207684f48dc28f99ab44cd7cae142fa22014039e7fd3bea2e903: Status 404 returned error can't find the container with id 1d85671d426d207684f48dc28f99ab44cd7cae142fa22014039e7fd3bea2e903
Sep 16 14:49:43.757408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:43.757370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:44.435640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.435562    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:49:44.439841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.439817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.442610 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.442590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-bde531-serving-cert\""
Sep 16 14:49:44.469292 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.469267    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:49:44.499668 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.499642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.499853 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.499705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.499853 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.499734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.499853 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.499775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblkb\" (UniqueName: \"kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.527091 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.527063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:44.600870 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.600837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.601020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.600896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.601020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.600921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.601020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.600987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblkb\" (UniqueName: \"kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.601020 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:44.600994    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-bde531-serving-cert: secret "maas-api-e2e-autores-bde531-serving-cert" not found
Sep 16 14:49:44.601231 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:49:44.601065    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls podName:a4ec1ffa-53d6-432a-836e-1fd7ca492716 nodeName:}" failed. No retries permitted until 2026-09-16 14:49:45.101044436 +0000 UTC m=+880.202519887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls") pod "maas-api-e2e-autores-bde531-5f844cc846-5bvlp" (UID: "a4ec1ffa-53d6-432a-836e-1fd7ca492716") : secret "maas-api-e2e-autores-bde531-serving-cert" not found
Sep 16 14:49:44.601601 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.601582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.603334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.603315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.611318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.611301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblkb\" (UniqueName: \"kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:44.628689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.628664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" event={"ID":"142f2aed-6513-414f-8db8-9661d59eec6b","Type":"ContainerStarted","Data":"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"}
Sep 16 14:49:44.628796 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.628714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" event={"ID":"142f2aed-6513-414f-8db8-9661d59eec6b","Type":"ContainerStarted","Data":"1d85671d426d207684f48dc28f99ab44cd7cae142fa22014039e7fd3bea2e903"}
Sep 16 14:49:44.628861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.628817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:44.654816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.654769    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" podStartSLOduration=2.340031458 podStartE2EDuration="2.654752096s" totalImagesPullingTime="314.720638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:44.652047041 +0000 UTC m=+879.753522494" watchObservedRunningTime="2026-09-16 14:49:44.654752096 +0000 UTC m=+879.756227553"
Sep 16 14:49:44.659092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.658930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:44.775794 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:44.775757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:45.105919 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.105830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:45.109627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.109597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") pod \"maas-api-e2e-autores-bde531-5f844cc846-5bvlp\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:45.156509 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.156476    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:45.249784 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.249752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:45.349995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.349931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:45.630469 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.630445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:49:45.632446 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:49:45.632418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ec1ffa_53d6_432a_836e_1fd7ca492716.slice/crio-346be53a49848f3b2e6ff853a956c9816befd14a35762e02ad407ccb8fc31335 WatchSource:0}: Error finding container 346be53a49848f3b2e6ff853a956c9816befd14a35762e02ad407ccb8fc31335: Status 404 returned error can't find the container with id 346be53a49848f3b2e6ff853a956c9816befd14a35762e02ad407ccb8fc31335
Sep 16 14:49:45.670885 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:45.670854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:46.381228 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:46.381195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:46.640872 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:46.640786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" event={"ID":"a4ec1ffa-53d6-432a-836e-1fd7ca492716","Type":"ContainerStarted","Data":"346be53a49848f3b2e6ff853a956c9816befd14a35762e02ad407ccb8fc31335"}
Sep 16 14:49:47.404230 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.404196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:47.513805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.513765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:47.615582 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.615549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:47.647257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.647229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" event={"ID":"a4ec1ffa-53d6-432a-836e-1fd7ca492716","Type":"ContainerStarted","Data":"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"}
Sep 16 14:49:47.647379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.647365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:47.668670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.668592    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" podStartSLOduration=1.785394012 podStartE2EDuration="3.668576824s" totalImagesPullingTime="1.883182812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:49:47.666987805 +0000 UTC m=+882.768463271" watchObservedRunningTime="2026-09-16 14:49:47.668576824 +0000 UTC m=+882.770052277"
Sep 16 14:49:47.717224 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.717198    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:47.927635 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:47.927541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:48.417753 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:48.417711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:49.082048 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:49.082016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:49.870622 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:49.870574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:50.055443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:50.055406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:50.621312 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:50.621279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:50.640407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:50.640376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:49:52.267513 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:52.267469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:52.366127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:52.366089    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:52.618842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:52.618773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 14:49:53.013145 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:53.013114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:53.658396 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:53.658369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:49:53.790682 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:53.790650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:54.540264 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:54.540221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:55.242441 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:55.242407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:55.463339 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:55.463307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:55.563680 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:55.563649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:55.859229 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:55.859148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.000247 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.000214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.123055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.122964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.464480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.464388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.564658 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.564620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.673203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.673144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:56.765218 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:56.765187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:57.452029 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:57.451993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.253575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.253484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.357524 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.357487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.493077 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.493034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.578899 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.578814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.698614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.698575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:58.924587 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:58.924501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:59.127631 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:59.127600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:59.347533 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:59.347505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:59.506305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:59.506270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:49:59.645750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:49:59.645664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:00.653389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:00.653352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:01.247397 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:01.247358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:01.306774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:01.306742    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:50:02.484217 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:02.484185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:03.061931 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:03.061886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.013558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.013525    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:50:04.017578 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.017553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.020542 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.020511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-e689e5-serving-cert\""
Sep 16 14:50:04.029555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.029531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:50:04.060781 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.060732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.154735 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.154702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.170767 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.170736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.170899 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.170793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.170899 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.170863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.171018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.170900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxgz\" (UniqueName: \"kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.272132 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.272060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.272132 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.272102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxgz\" (UniqueName: \"kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.272314 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.272164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.272314 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:50:04.272214    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-serving-cert: secret "maas-api-e2e-inf-b-e689e5-serving-cert" not found
Sep 16 14:50:04.272314 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.272233    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.272314 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:50:04.272277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls podName:3e5c88da-40ce-47b0-bdf7-de02862fc9ea nodeName:}" failed. No retries permitted until 2026-09-16 14:50:04.772257314 +0000 UTC m=+899.873732828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls") pod "maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" (UID: "3e5c88da-40ce-47b0-bdf7-de02862fc9ea") : secret "maas-api-e2e-inf-b-e689e5-serving-cert" not found
Sep 16 14:50:04.272951 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.272906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.274511 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.274493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.286294 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.286270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxgz\" (UniqueName: \"kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.352868 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.352828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.596200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.596123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.776694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.776663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.778986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.778959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") pod \"maas-api-e2e-inf-b-e689e5-658966dd99-glxcf\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:04.904988 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.904882    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:04.929516 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:04.929487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:05.005698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.005663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:05.154252 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.154209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:05.199784 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.199762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:50:05.201901 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:50:05.201877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5c88da_40ce_47b0_bdf7_de02862fc9ea.slice/crio-c2e232e9fb1dce3eaa9b700d05d73d476a48b00c6445277a81e058ef6e6af68f WatchSource:0}: Error finding container c2e232e9fb1dce3eaa9b700d05d73d476a48b00c6445277a81e058ef6e6af68f: Status 404 returned error can't find the container with id c2e232e9fb1dce3eaa9b700d05d73d476a48b00c6445277a81e058ef6e6af68f
Sep 16 14:50:05.254351 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.254316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:05.379295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.379265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:50:05.382059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.382027    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:50:05.740604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.740574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" event={"ID":"3e5c88da-40ce-47b0-bdf7-de02862fc9ea","Type":"ContainerStarted","Data":"c2e232e9fb1dce3eaa9b700d05d73d476a48b00c6445277a81e058ef6e6af68f"}
Sep 16 14:50:05.812395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:05.812363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:06.638481 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:06.638440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:06.747395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:06.747354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" event={"ID":"3e5c88da-40ce-47b0-bdf7-de02862fc9ea","Type":"ContainerStarted","Data":"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"}
Sep 16 14:50:06.747600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:06.747581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:06.766363 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:06.766319    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" podStartSLOduration=3.241894864 podStartE2EDuration="3.766304784s" totalImagesPullingTime="524.40992ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:06.76343297 +0000 UTC m=+901.864908422" watchObservedRunningTime="2026-09-16 14:50:06.766304784 +0000 UTC m=+901.867780310"
Sep 16 14:50:07.311655 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:07.311616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:07.899917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:07.899880    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:50:07.900330 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:07.900168    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" podUID="142f2aed-6513-414f-8db8-9661d59eec6b" containerName="maas-api" containerID="cri-o://a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b" gracePeriod=30
Sep 16 14:50:07.925702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:07.925676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:08.007166 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.007125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:08.148619 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.148597    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:50:08.310194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.309757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") pod \"142f2aed-6513-414f-8db8-9661d59eec6b\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") "
Sep 16 14:50:08.310194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.309811    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs\") pod \"142f2aed-6513-414f-8db8-9661d59eec6b\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") "
Sep 16 14:50:08.310194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.309851    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph4sd\" (UniqueName: \"kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd\") pod \"142f2aed-6513-414f-8db8-9661d59eec6b\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") "
Sep 16 14:50:08.310194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.309878    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca\") pod \"142f2aed-6513-414f-8db8-9661d59eec6b\" (UID: \"142f2aed-6513-414f-8db8-9661d59eec6b\") "
Sep 16 14:50:08.310565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.310356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "142f2aed-6513-414f-8db8-9661d59eec6b" (UID: "142f2aed-6513-414f-8db8-9661d59eec6b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:50:08.310844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.310810    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/142f2aed-6513-414f-8db8-9661d59eec6b-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:08.312780 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.312753    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd" (OuterVolumeSpecName: "kube-api-access-ph4sd") pod "142f2aed-6513-414f-8db8-9661d59eec6b" (UID: "142f2aed-6513-414f-8db8-9661d59eec6b"). InnerVolumeSpecName "kube-api-access-ph4sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:50:08.313022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.312995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "142f2aed-6513-414f-8db8-9661d59eec6b" (UID: "142f2aed-6513-414f-8db8-9661d59eec6b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:50:08.313205 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.313159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "142f2aed-6513-414f-8db8-9661d59eec6b" (UID: "142f2aed-6513-414f-8db8-9661d59eec6b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:50:08.411849 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.411821    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:08.411849 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.411846    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/142f2aed-6513-414f-8db8-9661d59eec6b-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:08.411849 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.411855    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph4sd\" (UniqueName: \"kubernetes.io/projected/142f2aed-6513-414f-8db8-9661d59eec6b-kube-api-access-ph4sd\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:08.760688 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.760652    2565 generic.go:356] "Generic (PLEG): container finished" podID="142f2aed-6513-414f-8db8-9661d59eec6b" containerID="a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b" exitCode=0
Sep 16 14:50:08.760855 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.760691    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"
Sep 16 14:50:08.760855 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.760737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" event={"ID":"142f2aed-6513-414f-8db8-9661d59eec6b","Type":"ContainerDied","Data":"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"}
Sep 16 14:50:08.760855 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.760794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m" event={"ID":"142f2aed-6513-414f-8db8-9661d59eec6b","Type":"ContainerDied","Data":"1d85671d426d207684f48dc28f99ab44cd7cae142fa22014039e7fd3bea2e903"}
Sep 16 14:50:08.760855 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.760825    2565 scope.go:117] "RemoveContainer" containerID="a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"
Sep 16 14:50:08.770701 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.770685    2565 scope.go:117] "RemoveContainer" containerID="a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"
Sep 16 14:50:08.770948 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:50:08.770923    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b\": container with ID starting with a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b not found: ID does not exist" containerID="a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"
Sep 16 14:50:08.770995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.770970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b"} err="failed to get container status \"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b\": rpc error: code = NotFound desc = could not find container \"a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b\": container with ID starting with a47035a95a68bcc9bae7b3740dc819c8df0516b37980bb22e1c83ac9ad39214b not found: ID does not exist"
Sep 16 14:50:08.786852 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.786828    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:50:08.794852 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:08.794831    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0252b3a9-5df9698c-vkr7m"]
Sep 16 14:50:09.377617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.377585    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:50:09.378100 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.378053    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="142f2aed-6513-414f-8db8-9661d59eec6b" containerName="maas-api"
Sep 16 14:50:09.378100 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.378069    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="142f2aed-6513-414f-8db8-9661d59eec6b" containerName="maas-api"
Sep 16 14:50:09.378211 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.378140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="142f2aed-6513-414f-8db8-9661d59eec6b" containerName="maas-api"
Sep 16 14:50:09.382250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.382228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.384884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.384862    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:50:09.385020 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.384919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-8dd97f83-gw-openshift-default-dockercfg-2q4lr\""
Sep 16 14:50:09.396683 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.396649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:50:09.419401 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvz9\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.419750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.419713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.494476 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.494445    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="142f2aed-6513-414f-8db8-9661d59eec6b" path="/var/lib/kubelet/pods/142f2aed-6513-414f-8db8-9661d59eec6b/volumes"
Sep 16 14:50:09.520222 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvz9\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520741 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.520965 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.520894    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.521026 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.521010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.521212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.521191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.522759 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.522741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.522891 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.522877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.528641 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.528612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvz9\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.528736 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.528647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token\") pod \"e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") " pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.693450 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.693370    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:09.971483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.971458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:50:09.973474 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:50:09.973450    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9839891a_abc1_44e2_a0b0_85db140d78c8.slice/crio-d9ea47a081fd2d3c334331644469419ca168bef3f250ecbbd96c31049562f918 WatchSource:0}: Error finding container d9ea47a081fd2d3c334331644469419ca168bef3f250ecbbd96c31049562f918: Status 404 returned error can't find the container with id d9ea47a081fd2d3c334331644469419ca168bef3f250ecbbd96c31049562f918
Sep 16 14:50:09.992986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:09.992956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:10.093041 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:10.093014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:10.437150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:10.437108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:10.776346 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:10.776307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerStarted","Data":"d9ea47a081fd2d3c334331644469419ca168bef3f250ecbbd96c31049562f918"}
Sep 16 14:50:11.142221 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:11.142141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:11.977288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:11.977248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:12.603257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.603219    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:12.603378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.603306    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:12.603378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.603349    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:12.759307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.759281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:50:12.791971 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.791883    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerStarted","Data":"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"}
Sep 16 14:50:12.813339 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:12.813283    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podStartSLOduration=1.185873896 podStartE2EDuration="3.81326074s" totalImagesPullingTime="2.627386844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:12.812299761 +0000 UTC m=+907.913775215" watchObservedRunningTime="2026-09-16 14:50:12.81326074 +0000 UTC m=+907.914736195"
Sep 16 14:50:13.694088 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:13.694061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:13.699419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:13.699396    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:13.797320 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:13.797285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:13.798145 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:13.798126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:14.874562 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:14.874531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:14.977922 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:14.977887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:15.747298 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:15.747259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:16.436289 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:16.436239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:17.123338 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:17.123303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:18.000649 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:18.000610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:18.848561 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:18.848517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:18.914800 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:18.914767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:19.067367 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.067333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:19.287776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.287744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:19.422032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.422001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:50:19.441263 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.441232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:19.542835 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.542759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:19.549048 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.549025    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:19.553003 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.552979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.555488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.555467    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-8dd97f83-dockercfg-q7gwp\""
Sep 16 14:50:19.555724 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.555707    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-8dd97f83\""
Sep 16 14:50:19.564494 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.564471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:19.609334 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.609299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrwk7\" (UniqueName: \"kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.609645 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.609616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.710192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.710147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.710369 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.710219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrwk7\" (UniqueName: \"kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.710866 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.710847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.719057 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.719031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrwk7\" (UniqueName: \"kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7\") pod \"payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.865789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.865717    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:19.872005 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:19.871980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:20.139744 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.139716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:20.141675 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:50:20.141647    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4719c3dc_0445_4fec_b2e9_b3f6dad7d6a6.slice/crio-198cd70a9aff0b6ccf8da0482fbc31995c98c0c2a0069432e1f614f6e10aa999 WatchSource:0}: Error finding container 198cd70a9aff0b6ccf8da0482fbc31995c98c0c2a0069432e1f614f6e10aa999: Status 404 returned error can't find the container with id 198cd70a9aff0b6ccf8da0482fbc31995c98c0c2a0069432e1f614f6e10aa999
Sep 16 14:50:20.645826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.645796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:20.831792 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.831757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" event={"ID":"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6","Type":"ContainerStarted","Data":"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"}
Sep 16 14:50:20.831957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.831809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" event={"ID":"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6","Type":"ContainerStarted","Data":"198cd70a9aff0b6ccf8da0482fbc31995c98c0c2a0069432e1f614f6e10aa999"}
Sep 16 14:50:20.831957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.831855    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:20.851605 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:20.851538    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" podStartSLOduration=1.8515195819999999 podStartE2EDuration="1.851519582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:20.849764044 +0000 UTC m=+915.951239497" watchObservedRunningTime="2026-09-16 14:50:20.851519582 +0000 UTC m=+915.952995039"
Sep 16 14:50:21.341547 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:21.341512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:22.701047 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:22.701011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:24.995530 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:24.995500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:31.839874 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:31.839843    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:36.929406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.929372    2565 generic.go:356] "Generic (PLEG): container finished" podID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerID="d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5" exitCode=0
Sep 16 14:50:36.929817 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.929446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerDied","Data":"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"}
Sep 16 14:50:36.929860 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.929833    2565 scope.go:117] "RemoveContainer" containerID="d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"
Sep 16 14:50:36.933483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.932891    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:36.933483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.933076    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:36.933483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:36.933171    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:37.937127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:37.937095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerStarted","Data":"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"}
Sep 16 14:50:38.513273 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:38.513240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:50:38.693858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:38.693822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:38.694041 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:38.694022    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:38.694088 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:38.694068    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:39.693728 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:39.693693    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:39.694134 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:39.693768    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:39.847347 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:39.847312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:40.694159 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:40.694126    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:40.694558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:40.694180    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:41.693999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:41.693968    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:41.694173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:41.694031    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:42.694389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:42.694355    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:42.694780 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:42.694409    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:43.694016 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:43.693979    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 16 14:50:43.694170 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:43.694035    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 16 14:50:43.797846 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:43.797812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:44.453826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:44.453798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:44.542582 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:44.542528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:44.698494 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:44.698469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:44.699385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:44.699367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:50:45.290614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:45.290579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:45.957479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:45.957449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:46.838232 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:46.838199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:47.538819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:47.538784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:48.337709 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:48.337669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:49.042901 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:49.042863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:49.849140 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:49.849106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:55.445998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:55.445962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:55.518098 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:55.518055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.059976 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.059926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.099409 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.099378    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:56.099645 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.099619    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" podUID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" containerName="payload-pre-processing" containerID="cri-o://f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640" gracePeriod=30
Sep 16 14:50:56.160214 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.160179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.276295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.276258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.351363 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.351341    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:56.363706 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.363670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.424068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.424039    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:50:56.424266 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.424241    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" containerID="cri-o://2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e" gracePeriod=30
Sep 16 14:50:56.448668 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.448641    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrwk7\" (UniqueName: \"kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7\") pod \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") "
Sep 16 14:50:56.449022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.448745    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume\") pod \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\" (UID: \"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6\") "
Sep 16 14:50:56.449134 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.449114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" (UID: "4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:50:56.450821 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.450794    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7" (OuterVolumeSpecName: "kube-api-access-rrwk7") pod "4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" (UID: "4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6"). InnerVolumeSpecName "kube-api-access-rrwk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:50:56.457266 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.457239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.550128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.550093    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.550128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.550125    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrwk7\" (UniqueName: \"kubernetes.io/projected/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6-kube-api-access-rrwk7\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:50:56.759787 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.759758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:56.934978 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:56.934919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:57.068317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.068179    2565 generic.go:356] "Generic (PLEG): container finished" podID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" containerID="f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640" exitCode=0
Sep 16 14:50:57.068317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.068218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" event={"ID":"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6","Type":"ContainerDied","Data":"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"}
Sep 16 14:50:57.068317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.068261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b" event={"ID":"4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6","Type":"ContainerDied","Data":"198cd70a9aff0b6ccf8da0482fbc31995c98c0c2a0069432e1f614f6e10aa999"}
Sep 16 14:50:57.068317 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.068282    2565 scope.go:117] "RemoveContainer" containerID="f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"
Sep 16 14:50:57.068645 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.068219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"
Sep 16 14:50:57.077637 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.077619    2565 scope.go:117] "RemoveContainer" containerID="f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"
Sep 16 14:50:57.077884 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:50:57.077870    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640\": container with ID starting with f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640 not found: ID does not exist" containerID="f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"
Sep 16 14:50:57.077929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.077891    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640"} err="failed to get container status \"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640\": rpc error: code = NotFound desc = could not find container \"f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640\": container with ID starting with f59e0b2015a0a31f77bec070b93fea64778bdabfa5bfdb19b60f1406a5ed0640 not found: ID does not exist"
Sep 16 14:50:57.110295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.110273    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:57.117073 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.117053    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b"]
Sep 16 14:50:57.215588 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.215558    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:50:57.215997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.215981    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" containerName="payload-pre-processing"
Sep 16 14:50:57.215997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.215995    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" containerName="payload-pre-processing"
Sep 16 14:50:57.216208 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.216057    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" containerName="payload-pre-processing"
Sep 16 14:50:57.220734 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.220708    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.224227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.224197    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ec2b25e3-openshift-default-dockercfg-mt6zc\""
Sep 16 14:50:57.235511 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.235489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:50:57.254065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.254030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:57.358250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whn2\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.358471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.358442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.431568 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.431524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:57.459539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whn2\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.459986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.460153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.460380    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.460416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.460596 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.460489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.462209 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.462190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.462599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.462581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.472295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.472273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whn2\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.472630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.472615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token\") pod \"e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") " pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.487916 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.487888    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6" path="/var/lib/kubelet/pods/4719c3dc-0445-4fec-b2e9-b3f6dad7d6a6/volumes"
Sep 16 14:50:57.531321 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.531303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:57.648218 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.648128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:57.809788 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.809760    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:50:57.811780 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:50:57.811754    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc1d049_54c9_493d_affd_5dd48318ffa7.slice/crio-a6bf48c316c99eb8ae4d7353eae4d05b7f1fc236c939342e35d6f16766582f7e WatchSource:0}: Error finding container a6bf48c316c99eb8ae4d7353eae4d05b7f1fc236c939342e35d6f16766582f7e: Status 404 returned error can't find the container with id a6bf48c316c99eb8ae4d7353eae4d05b7f1fc236c939342e35d6f16766582f7e
Sep 16 14:50:57.814023 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.813989    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:57.814108 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.814059    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:57.814149 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:57.814107    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:50:58.076698 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.076666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerStarted","Data":"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"}
Sep 16 14:50:58.076862 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.076715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerStarted","Data":"a6bf48c316c99eb8ae4d7353eae4d05b7f1fc236c939342e35d6f16766582f7e"}
Sep 16 14:50:58.098313 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.098260    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podStartSLOduration=1.098243229 podStartE2EDuration="1.098243229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:50:58.096952925 +0000 UTC m=+953.198428369" watchObservedRunningTime="2026-09-16 14:50:58.098243229 +0000 UTC m=+953.199718681"
Sep 16 14:50:58.531824 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.531796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:58.536893 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.536868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:58.744197 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:58.744161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:59.081981 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.081932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:59.082718 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.082698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:50:59.572246 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.572195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:59.665727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.665696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:50:59.701443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.701411    2565 patch_prober.go:28] interesting pod/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:50:59.701606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:50:59.701464    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:51:00.376638 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:00.376569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:01.261680 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.261646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:01.681323 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.681299    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:51:01.802172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802096    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802356    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnvz9\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802381    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data\") pod \"9839891a-abc1-44e2-a0b0-85db140d78c8\" (UID: \"9839891a-abc1-44e2-a0b0-85db140d78c8\") "
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802366    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:01.802428 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802583    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802672    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802788    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802802    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802811    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.802818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.802796    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:01.804522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.804495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:51:01.804630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.804506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9" (OuterVolumeSpecName: "kube-api-access-bnvz9") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "kube-api-access-bnvz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:01.804805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.804784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:01.804805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.804789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9839891a-abc1-44e2-a0b0-85db140d78c8" (UID: "9839891a-abc1-44e2-a0b0-85db140d78c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:01.903915 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903884    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.903915 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903911    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnvz9\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-kube-api-access-bnvz9\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.903915 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903922    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.904245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903931    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.904245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903963    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9839891a-abc1-44e2-a0b0-85db140d78c8-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.904245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.903974    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9839891a-abc1-44e2-a0b0-85db140d78c8-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:01.914051 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.914020    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:01.914693 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.914676    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:01.914778 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.914697    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:01.914843 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.914832    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:01.914881 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.914851    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:01.918598 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.918582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:01.921197 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.921174    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ec2b25e3-serving-cert\""
Sep 16 14:51:01.932481 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.931812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:51:01.932481 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.932421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:01.946551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:01.946517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:02.020876 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.020843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:02.097618 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.097532    2565 generic.go:356] "Generic (PLEG): container finished" podID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerID="2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e" exitCode=0
Sep 16 14:51:02.097618 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.097586    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"
Sep 16 14:51:02.097827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.097621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerDied","Data":"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"}
Sep 16 14:51:02.097827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.097681    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst" event={"ID":"9839891a-abc1-44e2-a0b0-85db140d78c8","Type":"ContainerDied","Data":"d9ea47a081fd2d3c334331644469419ca168bef3f250ecbbd96c31049562f918"}
Sep 16 14:51:02.097827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.097710    2565 scope.go:117] "RemoveContainer" containerID="2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"
Sep 16 14:51:02.105407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.105382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.105541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.105456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2dcm\" (UniqueName: \"kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.105541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.105487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.105541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.105509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.108401 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.108383    2565 scope.go:117] "RemoveContainer" containerID="d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"
Sep 16 14:51:02.116230 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.116211    2565 scope.go:117] "RemoveContainer" containerID="2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"
Sep 16 14:51:02.116475 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:02.116458    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e\": container with ID starting with 2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e not found: ID does not exist" containerID="2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"
Sep 16 14:51:02.116521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.116483    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e"} err="failed to get container status \"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e\": rpc error: code = NotFound desc = could not find container \"2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e\": container with ID starting with 2534c90ca03d62608181073e20bf19c0bdea33dfac4bd8a6ee1d57f776e3243e not found: ID does not exist"
Sep 16 14:51:02.116521 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.116498    2565 scope.go:117] "RemoveContainer" containerID="d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"
Sep 16 14:51:02.116724 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:02.116707    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5\": container with ID starting with d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5 not found: ID does not exist" containerID="d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"
Sep 16 14:51:02.116760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.116727    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5"} err="failed to get container status \"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5\": rpc error: code = NotFound desc = could not find container \"d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5\": container with ID starting with d2dbdfdf25bdd096f7ea2a62550103c191f365e3c866d8c620a032d524cf71b5 not found: ID does not exist"
Sep 16 14:51:02.120347 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.120323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:02.121435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.121417    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:51:02.135419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.131086    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst"]
Sep 16 14:51:02.206200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.206165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.206315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.206232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2dcm\" (UniqueName: \"kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.206315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.206258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.206315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.206281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.206884 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.206860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.208542 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.208523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.208610 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.208568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.217976 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.217953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2dcm\" (UniqueName: \"kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm\") pod \"maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.232984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.232947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:02.508292 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.508266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:02.510124 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:02.510093    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2420673d_eec7_44e1_8435_936b6feaba97.slice/crio-6432951a58e1a5e8059c8adf1e38917a3ef59e04932d22b638003cf701f7ac28 WatchSource:0}: Error finding container 6432951a58e1a5e8059c8adf1e38917a3ef59e04932d22b638003cf701f7ac28: Status 404 returned error can't find the container with id 6432951a58e1a5e8059c8adf1e38917a3ef59e04932d22b638003cf701f7ac28
Sep 16 14:51:02.584065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.584032    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:02.706458 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.706426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:02.790437 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.790363    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:02.790786 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.790772    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:02.790833 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.790787    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" containerName="istio-proxy"
Sep 16 14:51:02.794465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.794447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:02.797634 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.797613    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ec2b25e3-dockercfg-tqm4f\""
Sep 16 14:51:02.798364 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.798349    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ec2b25e3\""
Sep 16 14:51:02.823743 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.823713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:02.884540 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.884508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:02.887478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.887464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:02.903949 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.903909    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:02.912700 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.912673    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:02.912816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:02.912711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkj8w\" (UniqueName: \"kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.013870 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.013837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.013986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.013905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkj8w\" (UniqueName: \"kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.013986 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.013964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.014080 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.013993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2g7j\" (UniqueName: \"kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.014530 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.014512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.027437 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.027416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkj8w\" (UniqueName: \"kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w\") pod \"payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.104807 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.104715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" event={"ID":"2420673d-eec7-44e1-8435-936b6feaba97","Type":"ContainerStarted","Data":"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"}
Sep 16 14:51:03.104807 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.104778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" event={"ID":"2420673d-eec7-44e1-8435-936b6feaba97","Type":"ContainerStarted","Data":"6432951a58e1a5e8059c8adf1e38917a3ef59e04932d22b638003cf701f7ac28"}
Sep 16 14:51:03.105066 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.104876    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:03.105186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.105171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:03.115044 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.115023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.115111 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.115059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2g7j\" (UniqueName: \"kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.115866 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.115849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.124588 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.124568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2g7j\" (UniqueName: \"kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j\") pod \"payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") " pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.128562 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.128513    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" podStartSLOduration=1.7084498890000002 podStartE2EDuration="2.12849951s" totalImagesPullingTime="420.049621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:03.127566157 +0000 UTC m=+958.229041620" watchObservedRunningTime="2026-09-16 14:51:03.12849951 +0000 UTC m=+958.229974963"
Sep 16 14:51:03.196979 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.196950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:03.275165 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.275118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:03.395777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.395752    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:03.396895 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:03.396872    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf75f6b3_3aa1_4e3d_b53c_eba7d42043dc.slice/crio-593b3163d723dd8ca9253cbce1bd6bfbe0bcdda31269b7fdb1d9d57fd3e4f695 WatchSource:0}: Error finding container 593b3163d723dd8ca9253cbce1bd6bfbe0bcdda31269b7fdb1d9d57fd3e4f695: Status 404 returned error can't find the container with id 593b3163d723dd8ca9253cbce1bd6bfbe0bcdda31269b7fdb1d9d57fd3e4f695
Sep 16 14:51:03.473278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.473254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:03.475580 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:03.475552    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91013a0_2b02_42f4_8c81_59b20b4583e3.slice/crio-51b735f77b6d10816d654472ada607afe16ea86ef8ec637d95eddb2e20d5f1d3 WatchSource:0}: Error finding container 51b735f77b6d10816d654472ada607afe16ea86ef8ec637d95eddb2e20d5f1d3: Status 404 returned error can't find the container with id 51b735f77b6d10816d654472ada607afe16ea86ef8ec637d95eddb2e20d5f1d3
Sep 16 14:51:03.491221 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:03.491195    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9839891a-abc1-44e2-a0b0-85db140d78c8" path="/var/lib/kubelet/pods/9839891a-abc1-44e2-a0b0-85db140d78c8/volumes"
Sep 16 14:51:04.116239 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.116199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" event={"ID":"c91013a0-2b02-42f4-8c81-59b20b4583e3","Type":"ContainerStarted","Data":"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"}
Sep 16 14:51:04.116671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.116263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" event={"ID":"c91013a0-2b02-42f4-8c81-59b20b4583e3","Type":"ContainerStarted","Data":"51b735f77b6d10816d654472ada607afe16ea86ef8ec637d95eddb2e20d5f1d3"}
Sep 16 14:51:04.116671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.116304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:04.117873 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.117844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" event={"ID":"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc","Type":"ContainerStarted","Data":"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"}
Sep 16 14:51:04.118061 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.117886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" event={"ID":"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc","Type":"ContainerStarted","Data":"593b3163d723dd8ca9253cbce1bd6bfbe0bcdda31269b7fdb1d9d57fd3e4f695"}
Sep 16 14:51:04.142077 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.142034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" podStartSLOduration=2.142017793 podStartE2EDuration="2.142017793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:04.141726798 +0000 UTC m=+959.243202250" watchObservedRunningTime="2026-09-16 14:51:04.142017793 +0000 UTC m=+959.243493245"
Sep 16 14:51:04.169136 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.169098    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" podStartSLOduration=2.169084821 podStartE2EDuration="2.169084821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:04.168040755 +0000 UTC m=+959.269516207" watchObservedRunningTime="2026-09-16 14:51:04.169084821 +0000 UTC m=+959.270560274"
Sep 16 14:51:04.522585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:04.522548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:05.123580 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:05.123549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:05.266950 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:05.266907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:06.098999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:06.098958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:09.124016 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:09.123986    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:09.802319 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:09.802287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:15.125108 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:15.125080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:15.173826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:15.173789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:16.131139 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:16.131112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:23.126381 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:23.126340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:24.439533 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:24.439493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:25.236643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.236609    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerID="460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e" exitCode=0
Sep 16 14:51:25.236861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.236682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerDied","Data":"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"}
Sep 16 14:51:25.237081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.237068    2565 scope.go:117] "RemoveContainer" containerID="460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"
Sep 16 14:51:25.238163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.238137    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:25.238218 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.238208    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:25.238267 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.238256    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:25.469387 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:25.469346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:26.244249 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:26.244216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerStarted","Data":"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"}
Sep 16 14:51:26.434719 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:26.434684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:26.532393 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:26.532357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:26.533779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:26.533751    2565 patch_prober.go:28] interesting pod/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:51:26.533896 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:26.533814    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 14:51:27.169714 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:27.169672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:27.532705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:27.532673    2565 patch_prober.go:28] interesting pod/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:51:27.533114 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:27.532728    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 14:51:27.977993 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:27.977853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:28.532320 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:28.532286    2565 patch_prober.go:28] interesting pod/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:51:28.532499 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:28.532338    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 14:51:28.642143 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:28.642106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:28.914756 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:28.914659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:29.082320 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:29.082285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:29.526877 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:29.526838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:29.531921 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:29.531886    2565 patch_prober.go:28] interesting pod/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:51:29.532067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:29.531985    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 14:51:30.228366 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:30.228335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:30.523315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:30.523276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:51:30.532056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:30.532010    2565 patch_prober.go:28] interesting pod/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 16 14:51:30.532216 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:30.532094    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 16 14:51:31.056011 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.055970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:31.535838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.535801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:31.536702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.536682    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:31.778854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.778823    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:31.779110 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.779082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" podUID="2420673d-eec7-44e1-8435-936b6feaba97" containerName="maas-api" containerID="cri-o://d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178" gracePeriod=30
Sep 16 14:51:31.813305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.813186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:31.839076 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.839044    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:31.839310 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.839280    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" podUID="c91013a0-2b02-42f4-8c81-59b20b4583e3" containerName="payload-processing" containerID="cri-o://f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165" gracePeriod=30
Sep 16 14:51:31.845752 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.845726    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:31.845990 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.845967    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" podUID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" containerName="payload-pre-processing" containerID="cri-o://41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a" gracePeriod=30
Sep 16 14:51:31.913372 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:31.913342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:32.013804 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.013759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:32.075623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.075588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:32.100885 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.100816    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:32.143074 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.143041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:32.150470 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.150444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:32.210829 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.210793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls\") pod \"2420673d-eec7-44e1-8435-936b6feaba97\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") "
Sep 16 14:51:32.210829 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.210831    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca\") pod \"2420673d-eec7-44e1-8435-936b6feaba97\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") "
Sep 16 14:51:32.211115 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.210872    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs\") pod \"2420673d-eec7-44e1-8435-936b6feaba97\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") "
Sep 16 14:51:32.211115 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.210925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2dcm\" (UniqueName: \"kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm\") pod \"2420673d-eec7-44e1-8435-936b6feaba97\" (UID: \"2420673d-eec7-44e1-8435-936b6feaba97\") "
Sep 16 14:51:32.211270 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.211240    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2420673d-eec7-44e1-8435-936b6feaba97" (UID: "2420673d-eec7-44e1-8435-936b6feaba97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:32.213025 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.213001    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm" (OuterVolumeSpecName: "kube-api-access-n2dcm") pod "2420673d-eec7-44e1-8435-936b6feaba97" (UID: "2420673d-eec7-44e1-8435-936b6feaba97"). InnerVolumeSpecName "kube-api-access-n2dcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:32.213507 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.213484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2420673d-eec7-44e1-8435-936b6feaba97" (UID: "2420673d-eec7-44e1-8435-936b6feaba97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:32.213566 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.213493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2420673d-eec7-44e1-8435-936b6feaba97" (UID: "2420673d-eec7-44e1-8435-936b6feaba97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:32.294690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.294657    2565 generic.go:356] "Generic (PLEG): container finished" podID="c91013a0-2b02-42f4-8c81-59b20b4583e3" containerID="f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165" exitCode=0
Sep 16 14:51:32.294864 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.294699    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"
Sep 16 14:51:32.294864 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.294743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" event={"ID":"c91013a0-2b02-42f4-8c81-59b20b4583e3","Type":"ContainerDied","Data":"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"}
Sep 16 14:51:32.294864 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.294807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j" event={"ID":"c91013a0-2b02-42f4-8c81-59b20b4583e3","Type":"ContainerDied","Data":"51b735f77b6d10816d654472ada607afe16ea86ef8ec637d95eddb2e20d5f1d3"}
Sep 16 14:51:32.294864 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.294839    2565 scope.go:117] "RemoveContainer" containerID="f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"
Sep 16 14:51:32.296054 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.296030    2565 generic.go:356] "Generic (PLEG): container finished" podID="2420673d-eec7-44e1-8435-936b6feaba97" containerID="d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178" exitCode=0
Sep 16 14:51:32.296173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.296064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" event={"ID":"2420673d-eec7-44e1-8435-936b6feaba97","Type":"ContainerDied","Data":"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"}
Sep 16 14:51:32.296173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.296150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg" event={"ID":"2420673d-eec7-44e1-8435-936b6feaba97","Type":"ContainerDied","Data":"6432951a58e1a5e8059c8adf1e38917a3ef59e04932d22b638003cf701f7ac28"}
Sep 16 14:51:32.296287 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.296076    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"
Sep 16 14:51:32.297455 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.297429    2565 generic.go:356] "Generic (PLEG): container finished" podID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" containerID="41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a" exitCode=0
Sep 16 14:51:32.297571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.297465    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"
Sep 16 14:51:32.297571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.297465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" event={"ID":"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc","Type":"ContainerDied","Data":"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"}
Sep 16 14:51:32.297571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.297509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6" event={"ID":"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc","Type":"ContainerDied","Data":"593b3163d723dd8ca9253cbce1bd6bfbe0bcdda31269b7fdb1d9d57fd3e4f695"}
Sep 16 14:51:32.304336 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.304319    2565 scope.go:117] "RemoveContainer" containerID="f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"
Sep 16 14:51:32.304605 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:32.304588    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165\": container with ID starting with f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165 not found: ID does not exist" containerID="f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"
Sep 16 14:51:32.304653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.304613    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165"} err="failed to get container status \"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165\": rpc error: code = NotFound desc = could not find container \"f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165\": container with ID starting with f8d1200357e3c493a56600292602baea91590db7fa0a1d654dee5efe0e880165 not found: ID does not exist"
Sep 16 14:51:32.304653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.304627    2565 scope.go:117] "RemoveContainer" containerID="d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"
Sep 16 14:51:32.312143 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkj8w\" (UniqueName: \"kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w\") pod \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") "
Sep 16 14:51:32.312250 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume\") pod \"c91013a0-2b02-42f4-8c81-59b20b4583e3\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") "
Sep 16 14:51:32.312314 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2g7j\" (UniqueName: \"kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j\") pod \"c91013a0-2b02-42f4-8c81-59b20b4583e3\" (UID: \"c91013a0-2b02-42f4-8c81-59b20b4583e3\") "
Sep 16 14:51:32.312369 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume\") pod \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\" (UID: \"bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc\") "
Sep 16 14:51:32.312520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312501    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c91013a0-2b02-42f4-8c81-59b20b4583e3" (UID: "c91013a0-2b02-42f4-8c81-59b20b4583e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:32.312670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312651    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91013a0-2b02-42f4-8c81-59b20b4583e3-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.312795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312673    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.312795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312688    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2420673d-eec7-44e1-8435-936b6feaba97-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.312795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312701    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2420673d-eec7-44e1-8435-936b6feaba97-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.312795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" (UID: "bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:32.312795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312714    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2dcm\" (UniqueName: \"kubernetes.io/projected/2420673d-eec7-44e1-8435-936b6feaba97-kube-api-access-n2dcm\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.313160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.312893    2565 scope.go:117] "RemoveContainer" containerID="d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"
Sep 16 14:51:32.313220 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:32.313163    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178\": container with ID starting with d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178 not found: ID does not exist" containerID="d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"
Sep 16 14:51:32.313220 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.313186    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178"} err="failed to get container status \"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178\": rpc error: code = NotFound desc = could not find container \"d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178\": container with ID starting with d0134e82cbf2ad5d1c318fcc66543f6b007d22cef6686d400765c4118a3a8178 not found: ID does not exist"
Sep 16 14:51:32.313220 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.313200    2565 scope.go:117] "RemoveContainer" containerID="41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"
Sep 16 14:51:32.314448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.314429    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w" (OuterVolumeSpecName: "kube-api-access-vkj8w") pod "bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" (UID: "bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc"). InnerVolumeSpecName "kube-api-access-vkj8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:32.314514 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.314497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j" (OuterVolumeSpecName: "kube-api-access-w2g7j") pod "c91013a0-2b02-42f4-8c81-59b20b4583e3" (UID: "c91013a0-2b02-42f4-8c81-59b20b4583e3"). InnerVolumeSpecName "kube-api-access-w2g7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:32.320997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.320982    2565 scope.go:117] "RemoveContainer" containerID="41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"
Sep 16 14:51:32.321282 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:32.321266    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a\": container with ID starting with 41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a not found: ID does not exist" containerID="41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"
Sep 16 14:51:32.321345 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.321285    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a"} err="failed to get container status \"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a\": rpc error: code = NotFound desc = could not find container \"41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a\": container with ID starting with 41aa3afa8f5360f99b28d94d3dfe4bd1c8e019f558c6dca0e559e10be6eddd6a not found: ID does not exist"
Sep 16 14:51:32.343776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.343751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:32.351432 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.351412    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ec2b25e3-c96d69464-66qfg"]
Sep 16 14:51:32.413402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.413378    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2g7j\" (UniqueName: \"kubernetes.io/projected/c91013a0-2b02-42f4-8c81-59b20b4583e3-kube-api-access-w2g7j\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.413402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.413402    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.413656 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.413413    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkj8w\" (UniqueName: \"kubernetes.io/projected/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc-kube-api-access-vkj8w\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:32.467127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.467092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:32.620480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.620456    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:32.626083 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.626059    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j"]
Sep 16 14:51:32.637896 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.637872    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:32.641775 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:32.641755    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6"]
Sep 16 14:51:33.240745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.240714    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:51:33.258218 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.258188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:33.305378 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.305348    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy" containerID="cri-o://643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62" gracePeriod=30
Sep 16 14:51:33.340349 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.340316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:33.488363 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.488330    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2420673d-eec7-44e1-8435-936b6feaba97" path="/var/lib/kubelet/pods/2420673d-eec7-44e1-8435-936b6feaba97/volumes"
Sep 16 14:51:33.488701 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.488688    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" path="/var/lib/kubelet/pods/bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc/volumes"
Sep 16 14:51:33.489043 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.489026    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c91013a0-2b02-42f4-8c81-59b20b4583e3" path="/var/lib/kubelet/pods/c91013a0-2b02-42f4-8c81-59b20b4583e3/volumes"
Sep 16 14:51:33.670388 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.670352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:33.984138 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:51:33.984703 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984677    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2420673d-eec7-44e1-8435-936b6feaba97" containerName="maas-api"
Sep 16 14:51:33.984703 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984701    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2420673d-eec7-44e1-8435-936b6feaba97" containerName="maas-api"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984720    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" containerName="payload-pre-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984729    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" containerName="payload-pre-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984738    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c91013a0-2b02-42f4-8c81-59b20b4583e3" containerName="payload-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984748    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c91013a0-2b02-42f4-8c81-59b20b4583e3" containerName="payload-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984865    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf75f6b3-3aa1-4e3d-b53c-eba7d42043dc" containerName="payload-pre-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984876    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c91013a0-2b02-42f4-8c81-59b20b4583e3" containerName="payload-processing"
Sep 16 14:51:33.984886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.984885    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2420673d-eec7-44e1-8435-936b6feaba97" containerName="maas-api"
Sep 16 14:51:33.989122 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.989103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:33.992049 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:33.992027    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-eb086ade-openshift-default-dockercfg-xnzdt\""
Sep 16 14:51:34.004150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.004126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:51:34.018603 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.018577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:34.129954 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.129914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130136 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.129999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130136 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130136 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130243    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8868\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.130444 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.130315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.151460 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.151419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:34.231241 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8868\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231409 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231409 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.231933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.232031 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.231961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.232031 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.232004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.232239 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.232217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.233574 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.233550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.234050 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.234028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.244702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.244655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8868\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.244774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.244756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token\") pod \"e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") " pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.250587 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.250561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:34.311279 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.311252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:34.592974 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.592933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:51:34.594513 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:34.594486    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e583c0_c2cf_4c2b_b970_d4b4f7d5b7c3.slice/crio-4c7dbce1630ecacdb103aa2e0b3859e4911695d26ed15fbe2794dbfd8bcd19f4 WatchSource:0}: Error finding container 4c7dbce1630ecacdb103aa2e0b3859e4911695d26ed15fbe2794dbfd8bcd19f4: Status 404 returned error can't find the container with id 4c7dbce1630ecacdb103aa2e0b3859e4911695d26ed15fbe2794dbfd8bcd19f4
Sep 16 14:51:34.596620 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.596591    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:34.596683 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.596652    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:34.596683 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.596679    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:51:34.919254 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:34.919173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:35.317436 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:35.317402    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerStarted","Data":"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"}
Sep 16 14:51:35.317605 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:35.317460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerStarted","Data":"4c7dbce1630ecacdb103aa2e0b3859e4911695d26ed15fbe2794dbfd8bcd19f4"}
Sep 16 14:51:35.342408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:35.342365    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podStartSLOduration=2.342346427 podStartE2EDuration="2.342346427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:35.340306117 +0000 UTC m=+990.441781570" watchObservedRunningTime="2026-09-16 14:51:35.342346427 +0000 UTC m=+990.443821882"
Sep 16 14:51:35.620078 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:35.619964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:36.312008 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.311976    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:36.317279 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.317255    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:36.323423 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.323400    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:36.324212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.324194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:51:36.349523 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.349494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:36.795790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.795743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:36.897353 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:36.897315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:37.254541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:37.254509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:38.274889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.274850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:38.558258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.558232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:38.668081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2whn2\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668440 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668253    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668440 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668440 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668440 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy\") pod \"dbc1d049-54c9-493d-affd-5dd48318ffa7\" (UID: \"dbc1d049-54c9-493d-affd-5dd48318ffa7\") "
Sep 16 14:51:38.668646 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:38.668646 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:38.668751 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:38.668914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668850    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.668914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668872    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.668914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.668884    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.669310 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.669228    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:38.669410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.669388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:38.670590 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.670559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2" (OuterVolumeSpecName: "kube-api-access-2whn2") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "kube-api-access-2whn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:38.670693 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.670594    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:38.670929 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.670913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:51:38.671186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.671159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbc1d049-54c9-493d-affd-5dd48318ffa7" (UID: "dbc1d049-54c9-493d-affd-5dd48318ffa7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:51:38.770189 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770164    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbc1d049-54c9-493d-affd-5dd48318ffa7-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.770189 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770188    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.770359 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770199    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2whn2\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-kube-api-access-2whn2\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.770359 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770212    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.770359 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770223    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbc1d049-54c9-493d-affd-5dd48318ffa7-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:38.770359 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:38.770233    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbc1d049-54c9-493d-affd-5dd48318ffa7-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:39.159258 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.159211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:39.341237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.341205    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerID="643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62" exitCode=0
Sep 16 14:51:39.341643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.341266    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"
Sep 16 14:51:39.341643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.341265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerDied","Data":"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"}
Sep 16 14:51:39.341643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.341390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf" event={"ID":"dbc1d049-54c9-493d-affd-5dd48318ffa7","Type":"ContainerDied","Data":"a6bf48c316c99eb8ae4d7353eae4d05b7f1fc236c939342e35d6f16766582f7e"}
Sep 16 14:51:39.341643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.341417    2565 scope.go:117] "RemoveContainer" containerID="643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"
Sep 16 14:51:39.351467 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.351447    2565 scope.go:117] "RemoveContainer" containerID="460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"
Sep 16 14:51:39.360604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.360574    2565 scope.go:117] "RemoveContainer" containerID="643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"
Sep 16 14:51:39.360891 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:39.360874    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62\": container with ID starting with 643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62 not found: ID does not exist" containerID="643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"
Sep 16 14:51:39.360956 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.360901    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62"} err="failed to get container status \"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62\": rpc error: code = NotFound desc = could not find container \"643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62\": container with ID starting with 643a16df13c0eea9429e6a246ee834f02d191c1b57c3f181a1b6774c34da2c62 not found: ID does not exist"
Sep 16 14:51:39.360956 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.360917    2565 scope.go:117] "RemoveContainer" containerID="460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"
Sep 16 14:51:39.361230 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:39.361207    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e\": container with ID starting with 460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e not found: ID does not exist" containerID="460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"
Sep 16 14:51:39.361283 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.361239    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e"} err="failed to get container status \"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e\": rpc error: code = NotFound desc = could not find container \"460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e\": container with ID starting with 460b965742913f62c0960a28fe3b5742790896f45fd92ccc64214d46dba1a30e not found: ID does not exist"
Sep 16 14:51:39.366347 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.366324    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:51:39.371133 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.371101    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf"]
Sep 16 14:51:39.487057 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.486987    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" path="/var/lib/kubelet/pods/dbc1d049-54c9-493d-affd-5dd48318ffa7/volumes"
Sep 16 14:51:39.989281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:39.989247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:40.921951 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:40.921910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:41.658010 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.657975    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:51:41.658603 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658583    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.658675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658608    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.658675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658664    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.658675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.658827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658813    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.658863 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.658834    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc1d049-54c9-493d-affd-5dd48318ffa7" containerName="istio-proxy"
Sep 16 14:51:41.663322 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.663299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.666135 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.666113    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-eb086ade-serving-cert\""
Sep 16 14:51:41.676834 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.676764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:51:41.694726 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.694704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.694843 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.694761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.694843 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.694808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.694957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.694863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq64k\" (UniqueName: \"kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.703835 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.703808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:41.795304 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.795278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.795410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.795326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.795410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.795343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.795410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.795391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq64k\" (UniqueName: \"kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.795545 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:41.795431    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-serving-cert: secret "maas-api-e2e-derive-eb086ade-serving-cert" not found
Sep 16 14:51:41.795545 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:41.795505    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls podName:7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3 nodeName:}" failed. No retries permitted until 2026-09-16 14:51:42.295485747 +0000 UTC m=+997.396961182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls") pod "maas-api-e2e-derive-eb086ade-77c759498f-rrddq" (UID: "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3") : secret "maas-api-e2e-derive-eb086ade-serving-cert" not found
Sep 16 14:51:41.796128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.796110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.797776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.797756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:41.804537 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.804495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:41.806708 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:41.806683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq64k\" (UniqueName: \"kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:42.163958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.163905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:42.269009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.268973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:42.290320 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.290295    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:51:42.294079 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.294064    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.296789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.296765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-eb086ade-dockercfg-mkbtv\""
Sep 16 14:51:42.297032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.297018    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-eb086ade\""
Sep 16 14:51:42.299081 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.299060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.299168 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.299121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p84bb\" (UniqueName: \"kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.299168 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.299151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:42.302392 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.301976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") pod \"maas-api-e2e-derive-eb086ade-77c759498f-rrddq\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:42.304458 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.304437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:51:42.322278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.322257    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:51:42.325777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.325762    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.335644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.335616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:51:42.366097 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.366070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:42.399812 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.399781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p84bb\" (UniqueName: \"kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.399932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.399818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtmjg\" (UniqueName: \"kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.399932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.399839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.399932 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.399914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.400564 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.400546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.415883 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.415820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p84bb\" (UniqueName: \"kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb\") pod \"payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.500886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.500852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtmjg\" (UniqueName: \"kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.501060 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.500893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.501630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.501612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.514198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.514174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtmjg\" (UniqueName: \"kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg\") pod \"payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") " pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.578104 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.578076    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:42.615293 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.615265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:42.645581 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.645034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:42.856914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.855850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:42.856914 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.856525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:51:42.858508 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:42.858470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6ef0f3_3bd4_4902_8303_ea9a6fee5fa3.slice/crio-7905921ab636ee7bfbe1fd9df317cc3e19e5a9e27d85ec48158f4fca48eff6ab WatchSource:0}: Error finding container 7905921ab636ee7bfbe1fd9df317cc3e19e5a9e27d85ec48158f4fca48eff6ab: Status 404 returned error can't find the container with id 7905921ab636ee7bfbe1fd9df317cc3e19e5a9e27d85ec48158f4fca48eff6ab
Sep 16 14:51:42.859977 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.859959    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 14:51:42.913288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.913260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:51:42.914970 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:42.914933    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d617d5_3022_4ef1_b216_38df792114a5.slice/crio-2fe409b8eda53e816d0ae0af6d92a0bbfbac1946661e8b1cf59a752f9211efd7 WatchSource:0}: Error finding container 2fe409b8eda53e816d0ae0af6d92a0bbfbac1946661e8b1cf59a752f9211efd7: Status 404 returned error can't find the container with id 2fe409b8eda53e816d0ae0af6d92a0bbfbac1946661e8b1cf59a752f9211efd7
Sep 16 14:51:42.932900 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:42.932877    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:51:42.933563 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:51:42.933525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf731495f_62c0_4fa1_9740_363f2747cf7c.slice/crio-881a856cb921ee6303d169074125a8a3fde14ea422f0a0cbdbff6b03ebb2a878 WatchSource:0}: Error finding container 881a856cb921ee6303d169074125a8a3fde14ea422f0a0cbdbff6b03ebb2a878: Status 404 returned error can't find the container with id 881a856cb921ee6303d169074125a8a3fde14ea422f0a0cbdbff6b03ebb2a878
Sep 16 14:51:43.366468 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.366432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" event={"ID":"03d617d5-3022-4ef1-b216-38df792114a5","Type":"ContainerStarted","Data":"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"}
Sep 16 14:51:43.366926 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.366600    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:43.366926 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.366627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" event={"ID":"03d617d5-3022-4ef1-b216-38df792114a5","Type":"ContainerStarted","Data":"2fe409b8eda53e816d0ae0af6d92a0bbfbac1946661e8b1cf59a752f9211efd7"}
Sep 16 14:51:43.368188 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.368168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" event={"ID":"f731495f-62c0-4fa1-9740-363f2747cf7c","Type":"ContainerStarted","Data":"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"}
Sep 16 14:51:43.368263 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.368202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" event={"ID":"f731495f-62c0-4fa1-9740-363f2747cf7c","Type":"ContainerStarted","Data":"881a856cb921ee6303d169074125a8a3fde14ea422f0a0cbdbff6b03ebb2a878"}
Sep 16 14:51:43.368263 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.368224    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:43.369838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.369815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" event={"ID":"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3","Type":"ContainerStarted","Data":"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"}
Sep 16 14:51:43.369999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.369858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" event={"ID":"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3","Type":"ContainerStarted","Data":"7905921ab636ee7bfbe1fd9df317cc3e19e5a9e27d85ec48158f4fca48eff6ab"}
Sep 16 14:51:43.369999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.369885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:43.384728 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.384686    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" podStartSLOduration=1.384673745 podStartE2EDuration="1.384673745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:43.381950587 +0000 UTC m=+998.483426046" watchObservedRunningTime="2026-09-16 14:51:43.384673745 +0000 UTC m=+998.486149196"
Sep 16 14:51:43.398866 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.398815    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" podStartSLOduration=1.39879835 podStartE2EDuration="1.39879835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:43.39811128 +0000 UTC m=+998.499586758" watchObservedRunningTime="2026-09-16 14:51:43.39879835 +0000 UTC m=+998.500273804"
Sep 16 14:51:43.415227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.415182    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" podStartSLOduration=2.079938135 podStartE2EDuration="2.415167354s" totalImagesPullingTime="335.229219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:51:43.414192472 +0000 UTC m=+998.515667948" watchObservedRunningTime="2026-09-16 14:51:43.415167354 +0000 UTC m=+998.516642807"
Sep 16 14:51:43.534343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:43.534306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:44.200611 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:44.200580    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:44.947487 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:44.947454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:45.686187 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:45.686150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:46.454824 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:46.454787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:47.249067 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:47.249034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:49.381042 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:49.381015    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:51:52.648420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:52.648383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:52.817203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:52.817169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:51:53.375713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.375679    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:51:53.375968 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.375924    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" podUID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" containerName="maas-api" containerID="cri-o://e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede" gracePeriod=30
Sep 16 14:51:53.398955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.398914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:53.479103 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.479068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:53.549302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.549268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:53.615165 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.615140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:53.617249 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.617229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:51:53.698192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fblkb\" (UniqueName: \"kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb\") pod \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") "
Sep 16 14:51:53.698192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca\") pod \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") "
Sep 16 14:51:53.698666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs\") pod \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") "
Sep 16 14:51:53.698666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") pod \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\" (UID: \"a4ec1ffa-53d6-432a-836e-1fd7ca492716\") "
Sep 16 14:51:53.698666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a4ec1ffa-53d6-432a-836e-1fd7ca492716" (UID: "a4ec1ffa-53d6-432a-836e-1fd7ca492716"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:51:53.698666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.698625    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4ec1ffa-53d6-432a-836e-1fd7ca492716-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:53.700309 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.700283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a4ec1ffa-53d6-432a-836e-1fd7ca492716" (UID: "a4ec1ffa-53d6-432a-836e-1fd7ca492716"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:53.700402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.700350    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb" (OuterVolumeSpecName: "kube-api-access-fblkb") pod "a4ec1ffa-53d6-432a-836e-1fd7ca492716" (UID: "a4ec1ffa-53d6-432a-836e-1fd7ca492716"). InnerVolumeSpecName "kube-api-access-fblkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:51:53.700402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.700357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a4ec1ffa-53d6-432a-836e-1fd7ca492716" (UID: "a4ec1ffa-53d6-432a-836e-1fd7ca492716"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:51:53.799089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.799058    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:53.799089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.799084    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fblkb\" (UniqueName: \"kubernetes.io/projected/a4ec1ffa-53d6-432a-836e-1fd7ca492716-kube-api-access-fblkb\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:53.799089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.799094    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a4ec1ffa-53d6-432a-836e-1fd7ca492716-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:51:53.985594 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:53.985507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:54.086427 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.086394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:54.377523 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.377494    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:51:54.377699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.377579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:51:54.429095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.429050    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" containerID="e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede" exitCode=0
Sep 16 14:51:54.429095 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.429089    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"
Sep 16 14:51:54.429340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.429113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" event={"ID":"a4ec1ffa-53d6-432a-836e-1fd7ca492716","Type":"ContainerDied","Data":"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"}
Sep 16 14:51:54.429340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.429168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp" event={"ID":"a4ec1ffa-53d6-432a-836e-1fd7ca492716","Type":"ContainerDied","Data":"346be53a49848f3b2e6ff853a956c9816befd14a35762e02ad407ccb8fc31335"}
Sep 16 14:51:54.429340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.429199    2565 scope.go:117] "RemoveContainer" containerID="e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"
Sep 16 14:51:54.441816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.441794    2565 scope.go:117] "RemoveContainer" containerID="e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"
Sep 16 14:51:54.442430 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:51:54.442402    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede\": container with ID starting with e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede not found: ID does not exist" containerID="e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"
Sep 16 14:51:54.442546 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.442440    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede"} err="failed to get container status \"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede\": rpc error: code = NotFound desc = could not find container \"e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede\": container with ID starting with e4620932555aa0ff67aca1028e2a04d0e741e3c917cc6685e7e986ca2063eede not found: ID does not exist"
Sep 16 14:51:54.473465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.473437    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:51:54.480153 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.480130    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-bde531-5f844cc846-5bvlp"]
Sep 16 14:51:54.915307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:54.915276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:55.487856 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:55.487819    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" path="/var/lib/kubelet/pods/a4ec1ffa-53d6-432a-836e-1fd7ca492716/volumes"
Sep 16 14:51:55.974954 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:55.974908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:56.750913 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:56.750881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:57.516097 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:57.516062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:58.359544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:58.359507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:58.990650 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:58.990608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:51:59.678144 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:51:59.678103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:00.373608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:00.373556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:01.075745 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:01.075707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:01.903303 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:01.903265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:02.583590 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:02.583557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:03.364615 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.364582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:03.483349 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.483314    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerID="424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6" exitCode=0
Sep 16 14:52:03.487489 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.487459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerDied","Data":"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"}
Sep 16 14:52:03.487816 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.487799    2565 scope.go:117] "RemoveContainer" containerID="424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"
Sep 16 14:52:03.488887 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.488857    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:03.488973 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.488933    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:03.489018 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:03.488978    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:04.490794 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:04.490763    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerStarted","Data":"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"}
Sep 16 14:52:05.311640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.311605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:52:05.312879 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.312850    2565 patch_prober.go:28] interesting pod/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:52:05.313025 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.312899    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 14:52:05.536407 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.536367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:05.659561 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.659475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:05.846917 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:05.846883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:06.311609 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:06.311575    2565 patch_prober.go:28] interesting pod/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:52:06.311830 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:06.311635    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 14:52:06.323517 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:06.323481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:52:06.521587 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:06.521556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:07.312600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:07.312565    2565 patch_prober.go:28] interesting pod/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:52:07.313019 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:07.312619    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 14:52:08.130613 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.130573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:08.311716 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.311684    2565 patch_prober.go:28] interesting pod/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 16 14:52:08.311895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.311743    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 16 14:52:08.687683 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.687612    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:52:08.688200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.687795    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" podUID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" containerName="maas-api" containerID="cri-o://8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316" gracePeriod=30
Sep 16 14:52:08.724315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.724282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:08.747699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.747665    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:52:08.747958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.747919    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" podUID="f731495f-62c0-4fa1-9740-363f2747cf7c" containerName="payload-processing" containerID="cri-o://d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0" gracePeriod=30
Sep 16 14:52:08.795994 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.795341    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:52:08.797690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.796288    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" podUID="03d617d5-3022-4ef1-b216-38df792114a5" containerName="payload-pre-processing" containerID="cri-o://e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3" gracePeriod=30
Sep 16 14:52:08.819729 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:08.819690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:09.044704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.044680    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:52:09.044883 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.044863    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy" containerID="cri-o://c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7" gracePeriod=30
Sep 16 14:52:09.096332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.096229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:52:09.142592 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.142564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq64k\" (UniqueName: \"kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k\") pod \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") "
Sep 16 14:52:09.142877 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.142855    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs\") pod \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") "
Sep 16 14:52:09.143059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.143042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca\") pod \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") "
Sep 16 14:52:09.143186 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.143171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") pod \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\" (UID: \"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3\") "
Sep 16 14:52:09.143634 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.143594    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" (UID: "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:52:09.145991 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.145971    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k" (OuterVolumeSpecName: "kube-api-access-qq64k") pod "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" (UID: "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3"). InnerVolumeSpecName "kube-api-access-qq64k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:09.146862 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.146839    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" (UID: "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:52:09.147456 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.147414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" (UID: "7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:52:09.149423 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.149403    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:52:09.193561 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.193538    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:52:09.244459 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p84bb\" (UniqueName: \"kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb\") pod \"03d617d5-3022-4ef1-b216-38df792114a5\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") "
Sep 16 14:52:09.244590 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244509    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume\") pod \"03d617d5-3022-4ef1-b216-38df792114a5\" (UID: \"03d617d5-3022-4ef1-b216-38df792114a5\") "
Sep 16 14:52:09.244590 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244529    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtmjg\" (UniqueName: \"kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg\") pod \"f731495f-62c0-4fa1-9740-363f2747cf7c\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") "
Sep 16 14:52:09.244590 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume\") pod \"f731495f-62c0-4fa1-9740-363f2747cf7c\" (UID: \"f731495f-62c0-4fa1-9740-363f2747cf7c\") "
Sep 16 14:52:09.244772 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244761    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.244809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244774    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.244809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244782    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq64k\" (UniqueName: \"kubernetes.io/projected/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-kube-api-access-qq64k\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.244809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244790    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.244910 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.244874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03d617d5-3022-4ef1-b216-38df792114a5" (UID: "03d617d5-3022-4ef1-b216-38df792114a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:52:09.245086 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.245070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f731495f-62c0-4fa1-9740-363f2747cf7c" (UID: "f731495f-62c0-4fa1-9740-363f2747cf7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:52:09.246524 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.246503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg" (OuterVolumeSpecName: "kube-api-access-qtmjg") pod "f731495f-62c0-4fa1-9740-363f2747cf7c" (UID: "f731495f-62c0-4fa1-9740-363f2747cf7c"). InnerVolumeSpecName "kube-api-access-qtmjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:09.246731 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.246715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb" (OuterVolumeSpecName: "kube-api-access-p84bb") pod "03d617d5-3022-4ef1-b216-38df792114a5" (UID: "03d617d5-3022-4ef1-b216-38df792114a5"). InnerVolumeSpecName "kube-api-access-p84bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:09.346158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.346129    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03d617d5-3022-4ef1-b216-38df792114a5-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.346158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.346154    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtmjg\" (UniqueName: \"kubernetes.io/projected/f731495f-62c0-4fa1-9740-363f2747cf7c-kube-api-access-qtmjg\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.346158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.346163    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f731495f-62c0-4fa1-9740-363f2747cf7c-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.346392 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.346172    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p84bb\" (UniqueName: \"kubernetes.io/projected/03d617d5-3022-4ef1-b216-38df792114a5-kube-api-access-p84bb\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:09.517641 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.517610    2565 generic.go:356] "Generic (PLEG): container finished" podID="03d617d5-3022-4ef1-b216-38df792114a5" containerID="e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3" exitCode=0
Sep 16 14:52:09.517758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.517654    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"
Sep 16 14:52:09.517758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.517706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" event={"ID":"03d617d5-3022-4ef1-b216-38df792114a5","Type":"ContainerDied","Data":"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"}
Sep 16 14:52:09.517865 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.517772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb" event={"ID":"03d617d5-3022-4ef1-b216-38df792114a5","Type":"ContainerDied","Data":"2fe409b8eda53e816d0ae0af6d92a0bbfbac1946661e8b1cf59a752f9211efd7"}
Sep 16 14:52:09.517865 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.517804    2565 scope.go:117] "RemoveContainer" containerID="e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"
Sep 16 14:52:09.519069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.519008    2565 generic.go:356] "Generic (PLEG): container finished" podID="f731495f-62c0-4fa1-9740-363f2747cf7c" containerID="d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0" exitCode=0
Sep 16 14:52:09.519069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.519057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"
Sep 16 14:52:09.519199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.519091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" event={"ID":"f731495f-62c0-4fa1-9740-363f2747cf7c","Type":"ContainerDied","Data":"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"}
Sep 16 14:52:09.519199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.519130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52" event={"ID":"f731495f-62c0-4fa1-9740-363f2747cf7c","Type":"ContainerDied","Data":"881a856cb921ee6303d169074125a8a3fde14ea422f0a0cbdbff6b03ebb2a878"}
Sep 16 14:52:09.520725 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.520704    2565 generic.go:356] "Generic (PLEG): container finished" podID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" containerID="8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316" exitCode=0
Sep 16 14:52:09.520838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.520748    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"
Sep 16 14:52:09.520838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.520824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" event={"ID":"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3","Type":"ContainerDied","Data":"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"}
Sep 16 14:52:09.520958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.520866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq" event={"ID":"7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3","Type":"ContainerDied","Data":"7905921ab636ee7bfbe1fd9df317cc3e19e5a9e27d85ec48158f4fca48eff6ab"}
Sep 16 14:52:09.527825 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.527809    2565 scope.go:117] "RemoveContainer" containerID="e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"
Sep 16 14:52:09.528170 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:09.528149    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3\": container with ID starting with e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3 not found: ID does not exist" containerID="e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"
Sep 16 14:52:09.528262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.528178    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3"} err="failed to get container status \"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3\": rpc error: code = NotFound desc = could not find container \"e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3\": container with ID starting with e73ab87f4dd03026bf175f39c86d904a917fadf44a780f67fa8536dac4915ac3 not found: ID does not exist"
Sep 16 14:52:09.528262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.528193    2565 scope.go:117] "RemoveContainer" containerID="d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"
Sep 16 14:52:09.538815 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.538792    2565 scope.go:117] "RemoveContainer" containerID="d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"
Sep 16 14:52:09.539298 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:09.539273    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0\": container with ID starting with d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0 not found: ID does not exist" containerID="d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"
Sep 16 14:52:09.539389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.539305    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0"} err="failed to get container status \"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0\": rpc error: code = NotFound desc = could not find container \"d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0\": container with ID starting with d996f87efe2f3bb588a6dfdcf4f808cb85eaf44cf086405a6e9ac8f528c6fad0 not found: ID does not exist"
Sep 16 14:52:09.539389 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.539323    2565 scope.go:117] "RemoveContainer" containerID="8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"
Sep 16 14:52:09.543249 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.543224    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:52:09.546429 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.546410    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-eb086ade-77c759498f-rrddq"]
Sep 16 14:52:09.549034 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.549008    2565 scope.go:117] "RemoveContainer" containerID="8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"
Sep 16 14:52:09.549287 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:09.549269    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316\": container with ID starting with 8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316 not found: ID does not exist" containerID="8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"
Sep 16 14:52:09.549341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.549291    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316"} err="failed to get container status \"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316\": rpc error: code = NotFound desc = could not find container \"8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316\": container with ID starting with 8215b72e7ef8fe74aaa157e7f3c1041316f4e0cfc2de690bf6436ace4df40316 not found: ID does not exist"
Sep 16 14:52:09.557549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.557525    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:52:09.565126 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.565108    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb"]
Sep 16 14:52:09.577944 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.577912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:52:09.581963 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:09.581923    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52"]
Sep 16 14:52:10.189401 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:10.189371    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:10.289446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:10.289404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:10.825066 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:10.825037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:52:11.046488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.046435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:11.320657 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.320617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:11.487871 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.487829    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03d617d5-3022-4ef1-b216-38df792114a5" path="/var/lib/kubelet/pods/03d617d5-3022-4ef1-b216-38df792114a5/volumes"
Sep 16 14:52:11.488306 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.488286    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" path="/var/lib/kubelet/pods/7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3/volumes"
Sep 16 14:52:11.488671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.488652    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f731495f-62c0-4fa1-9740-363f2747cf7c" path="/var/lib/kubelet/pods/f731495f-62c0-4fa1-9740-363f2747cf7c/volumes"
Sep 16 14:52:11.746204 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:11.746111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:12.429622 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:12.429586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:14.993553 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:14.993531    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:52:15.099199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099117    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8868\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099315    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099437    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data\") pod \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\" (UID: \"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3\") "
Sep 16 14:52:15.099705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099445    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:15.099705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099570    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:15.099903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:15.099903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099798    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.099903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099817    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.099903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:15.099903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.099792    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:52:15.101450 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.101423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868" (OuterVolumeSpecName: "kube-api-access-w8868") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "kube-api-access-w8868". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:15.101578 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.101458    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:52:15.101694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.101676    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:52:15.101760 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.101746    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" (UID: "c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:52:15.200522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200489    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200516    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200528    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200540    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200551    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8868\" (UniqueName: \"kubernetes.io/projected/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-kube-api-access-w8868\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200561    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.200750 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.200572    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:52:15.558022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.557990    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerID="c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7" exitCode=0
Sep 16 14:52:15.558174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.558047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"
Sep 16 14:52:15.558174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.558069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerDied","Data":"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"}
Sep 16 14:52:15.558174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.558118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z" event={"ID":"c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3","Type":"ContainerDied","Data":"4c7dbce1630ecacdb103aa2e0b3859e4911695d26ed15fbe2794dbfd8bcd19f4"}
Sep 16 14:52:15.558174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.558141    2565 scope.go:117] "RemoveContainer" containerID="c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"
Sep 16 14:52:15.567128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.567074    2565 scope.go:117] "RemoveContainer" containerID="424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"
Sep 16 14:52:15.580671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.580650    2565 scope.go:117] "RemoveContainer" containerID="c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"
Sep 16 14:52:15.580933 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:15.580915    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7\": container with ID starting with c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7 not found: ID does not exist" containerID="c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"
Sep 16 14:52:15.580992 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.580957    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7"} err="failed to get container status \"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7\": rpc error: code = NotFound desc = could not find container \"c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7\": container with ID starting with c5fd4706f16e179bf4086b8a67b7862bb19717b0dc83aafd93d516d19df2aba7 not found: ID does not exist"
Sep 16 14:52:15.581036 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.580987    2565 scope.go:117] "RemoveContainer" containerID="424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"
Sep 16 14:52:15.581220 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.581202    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:52:15.581280 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:15.581252    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6\": container with ID starting with 424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6 not found: ID does not exist" containerID="424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"
Sep 16 14:52:15.581280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.581271    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6"} err="failed to get container status \"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6\": rpc error: code = NotFound desc = could not find container \"424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6\": container with ID starting with 424edbea91951be4dae8e1556082d5dee8125bdb5e62264ff2c8353f47bdf0e6 not found: ID does not exist"
Sep 16 14:52:15.585003 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:15.584983    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z"]
Sep 16 14:52:17.056279 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:17.056239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:17.211886 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:17.211856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:17.310933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:17.310850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:17.487589 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:17.487547    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" path="/var/lib/kubelet/pods/c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3/volumes"
Sep 16 14:52:17.717073 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:17.716989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:23.113786 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:23.113750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:52:35.793281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:35.793249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:36.033625 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.033590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:36.479464 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.479430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:36.771823 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.771790    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:52:36.772495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772462    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.772495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772481    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.772495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772491    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.772495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772497    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772508    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772513    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772520    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772525    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772540    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03d617d5-3022-4ef1-b216-38df792114a5" containerName="payload-pre-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772545    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03d617d5-3022-4ef1-b216-38df792114a5" containerName="payload-pre-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772551    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f731495f-62c0-4fa1-9740-363f2747cf7c" containerName="payload-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772556    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f731495f-62c0-4fa1-9740-363f2747cf7c" containerName="payload-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772616    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ec1ffa-53d6-432a-836e-1fd7ca492716" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772624    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6ef0f3-3bd4-4902-8303-ea9a6fee5fa3" containerName="maas-api"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772629    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03d617d5-3022-4ef1-b216-38df792114a5" containerName="payload-pre-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772637    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772642    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f731495f-62c0-4fa1-9740-363f2747cf7c" containerName="payload-processing"
Sep 16 14:52:36.772774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.772647    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0e583c0-c2cf-4c2b-b970-d4b4f7d5b7c3" containerName="istio-proxy"
Sep 16 14:52:36.775838 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.775815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.778621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.778602    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-230a34-openshift-default-dockercfg-cxbrc\""
Sep 16 14:52:36.778621 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.778611    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 14:52:36.790439 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.790414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:52:36.888832 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.888805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.888842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.888881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.888932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5njs\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.888994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.889018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.889068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.889109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.889226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.889142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.989854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.989822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.989886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.989913    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.989970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.989988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5njs\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990644 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.990723 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.990675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.992338 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.992320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.992643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.992625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.998627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.998601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:36.998801 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:36.998783    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5njs\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs\") pod \"e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") " pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:37.089307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.089241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:37.364398 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.364374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:52:37.366450 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:52:37.366418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63d51c4_3f47_4ffe_9030_81238e140319.slice/crio-698010b2d2356137b2eaa3073d0cdc1613d01d913583de7c79096ac78c716d25 WatchSource:0}: Error finding container 698010b2d2356137b2eaa3073d0cdc1613d01d913583de7c79096ac78c716d25: Status 404 returned error can't find the container with id 698010b2d2356137b2eaa3073d0cdc1613d01d913583de7c79096ac78c716d25
Sep 16 14:52:37.368795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.368761    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:37.368895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.368825    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:37.368895 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.368854    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:52:37.672302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.672211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerStarted","Data":"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"}
Sep 16 14:52:37.672302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.672265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerStarted","Data":"698010b2d2356137b2eaa3073d0cdc1613d01d913583de7c79096ac78c716d25"}
Sep 16 14:52:37.695231 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.694813    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podStartSLOduration=1.694792444 podStartE2EDuration="1.694792444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:52:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:52:37.694320994 +0000 UTC m=+1052.795796448" watchObservedRunningTime="2026-09-16 14:52:37.694792444 +0000 UTC m=+1052.796267899"
Sep 16 14:52:37.995449 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:37.995354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:38.089382 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.089348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:38.094300 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.094272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:38.095096 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.095061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:38.677789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.677757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:38.678722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.678694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:52:38.953776 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:38.953661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:39.654038 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:39.653998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:39.871316 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:39.871273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:40.514878 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:40.514844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:41.625225 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:41.625194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:42.367202 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:42.367166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.009313 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.009275    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:52:43.013146 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.013123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.015280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.015258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-230a34-serving-cert\""
Sep 16 14:52:43.024316 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.024282    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:52:43.033314 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.033286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrzp\" (UniqueName: \"kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.033427 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.033403    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.033479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.033460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.033527 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.033486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.041715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.041690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.117038 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.117009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:52:43.120497 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.120457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.134484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.134461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrzp\" (UniqueName: \"kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.134608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.134523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.134608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.134552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.134608 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.134567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.134960 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:43.134684    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-serving-cert: secret "maas-api-e2e-explicit-230a34-serving-cert" not found
Sep 16 14:52:43.134960 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:52:43.134756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls podName:3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577 nodeName:}" failed. No retries permitted until 2026-09-16 14:52:43.63473769 +0000 UTC m=+1058.736213141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls") pod "maas-api-e2e-explicit-230a34-765856df6-2hbsh" (UID: "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577") : secret "maas-api-e2e-explicit-230a34-serving-cert" not found
Sep 16 14:52:43.135269 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.135245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.137068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.137050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.145606 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.145587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrzp\" (UniqueName: \"kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.521565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.521527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.638462 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.638431    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:52:43.639699 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.639673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.642055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.642032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") pod \"maas-api-e2e-explicit-230a34-765856df6-2hbsh\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.642337 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.642322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.646063 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.646032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-230a34-dockercfg-8mzrd\""
Sep 16 14:52:43.646213 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.646195    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-230a34\""
Sep 16 14:52:43.655711 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.654257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:52:43.700433 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.700400    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:52:43.704211 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.704196    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.712780 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.712761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:52:43.740102 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.740074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.740227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.740108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh5rx\" (UniqueName: \"kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.740227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.740144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.740304 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.740236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlz65\" (UniqueName: \"kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.840777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.840700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.840928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.840839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlz65\" (UniqueName: \"kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.840928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.840874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.840928 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.840900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh5rx\" (UniqueName: \"kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.841429 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.841410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.841531 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.841515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.843136 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.843111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.849084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.849057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh5rx\" (UniqueName: \"kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx\") pod \"payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") " pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:43.849567 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.849547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlz65\" (UniqueName: \"kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65\") pod \"payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:43.926049 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.926024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:43.941832 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.941808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:43.966963 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:43.966905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:44.015264 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.015234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:44.198588 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.198566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:52:44.200781 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:52:44.200751    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f58e8f4_5ed5_478f_a4ed_c9ed33f3b577.slice/crio-0812175f3df7411e2f482e7b25dcb1defe2aff66d846ba3bee63870d918d7274 WatchSource:0}: Error finding container 0812175f3df7411e2f482e7b25dcb1defe2aff66d846ba3bee63870d918d7274: Status 404 returned error can't find the container with id 0812175f3df7411e2f482e7b25dcb1defe2aff66d846ba3bee63870d918d7274
Sep 16 14:52:44.247021 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.246997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:52:44.248890 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:52:44.248867    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b85c4e4_e803_4feb_bc5d_6a29a471dc3f.slice/crio-ed3b9a9ced00446b370e905ea224cecb2633b764b1df75dff837178d8f524064 WatchSource:0}: Error finding container ed3b9a9ced00446b370e905ea224cecb2633b764b1df75dff837178d8f524064: Status 404 returned error can't find the container with id ed3b9a9ced00446b370e905ea224cecb2633b764b1df75dff837178d8f524064
Sep 16 14:52:44.291889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.291771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:52:44.294067 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:52:44.294045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376bdd4d_270f_4a5b_9acc_6b2d89e9dc29.slice/crio-b0391f4c49fcac63406de94bb219d856b45f8cbb05883ed7e824a9bbe4b0b430 WatchSource:0}: Error finding container b0391f4c49fcac63406de94bb219d856b45f8cbb05883ed7e824a9bbe4b0b430: Status 404 returned error can't find the container with id b0391f4c49fcac63406de94bb219d856b45f8cbb05883ed7e824a9bbe4b0b430
Sep 16 14:52:44.710844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.710818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" event={"ID":"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29","Type":"ContainerStarted","Data":"e48830bf3c47109fd7fd842f5720b0369132907357c0f5adab9edb19d6528a21"}
Sep 16 14:52:44.710966 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.710871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" event={"ID":"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29","Type":"ContainerStarted","Data":"b0391f4c49fcac63406de94bb219d856b45f8cbb05883ed7e824a9bbe4b0b430"}
Sep 16 14:52:44.710966 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.710958    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:44.712653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.712521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" event={"ID":"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f","Type":"ContainerStarted","Data":"48396740ed291e379b1d353a9299275c9d9a8b9a660d23416659791af2deeda7"}
Sep 16 14:52:44.712653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.712567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:44.712653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.712590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" event={"ID":"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f","Type":"ContainerStarted","Data":"ed3b9a9ced00446b370e905ea224cecb2633b764b1df75dff837178d8f524064"}
Sep 16 14:52:44.714262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.714233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" event={"ID":"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577","Type":"ContainerStarted","Data":"0812175f3df7411e2f482e7b25dcb1defe2aff66d846ba3bee63870d918d7274"}
Sep 16 14:52:44.727763 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.727714    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" podStartSLOduration=1.727694692 podStartE2EDuration="1.727694692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:52:44.726166749 +0000 UTC m=+1059.827642204" watchObservedRunningTime="2026-09-16 14:52:44.727694692 +0000 UTC m=+1059.829170146"
Sep 16 14:52:44.743844 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:44.743792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" podStartSLOduration=1.7437722249999998 podStartE2EDuration="1.743772225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:52:44.74224837 +0000 UTC m=+1059.843723824" watchObservedRunningTime="2026-09-16 14:52:44.743772225 +0000 UTC m=+1059.845247681"
Sep 16 14:52:45.722486 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:45.722451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" event={"ID":"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577","Type":"ContainerStarted","Data":"afe3c16097cd80aa2b04a0335e3f6e8c51ba43e25d79279783e52efdcc8e24de"}
Sep 16 14:52:45.722985 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:45.722532    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:45.742424 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:45.742379    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" podStartSLOduration=3.286062882 podStartE2EDuration="3.742363537s" totalImagesPullingTime="456.300655ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:52:45.740194646 +0000 UTC m=+1060.841670098" watchObservedRunningTime="2026-09-16 14:52:45.742363537 +0000 UTC m=+1060.843838989"
Sep 16 14:52:50.310765 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:50.310724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:50.389262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:50.389227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:52:51.733311 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:51.733285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:52:55.724483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:55.724452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:52:55.724880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:55.724519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:52:56.205495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:52:56.205460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:04.714059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.713971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:53:04.826210 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.826180    2565 generic.go:356] "Generic (PLEG): container finished" podID="d63d51c4-3f47-4ffe-9030-81238e140319" containerID="ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2" exitCode=0
Sep 16 14:53:04.826365 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.826247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerDied","Data":"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"}
Sep 16 14:53:04.826616 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.826602    2565 scope.go:117] "RemoveContainer" containerID="ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"
Sep 16 14:53:04.827658 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.827633    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:53:04.827720 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.827698    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:53:04.827758 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:04.827733    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:53:05.491480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:05.491447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:05.833742 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:05.833704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerStarted","Data":"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"}
Sep 16 14:53:06.089472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:06.089389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:53:06.090796 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:06.090762    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 14:53:06.090978 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:06.090819    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 14:53:06.698695 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:06.698650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:07.024474 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:07.024443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:07.089983 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:07.089921    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 14:53:07.090152 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:07.090019    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 14:53:07.697393 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:07.697367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:08.090414 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:08.090378    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 14:53:08.090808 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:08.090432    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 14:53:08.391604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:08.391513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:08.678147 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:08.678055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:53:09.090026 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:09.089988    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 14:53:09.090206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:09.090046    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 14:53:09.238278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:09.238244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:09.698904 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:09.698867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:10.074350 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:10.074318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:10.090555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:10.090527    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 16 14:53:10.090725 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:10.090582    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 16 14:53:10.197343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:10.197304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:11.094231 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:11.094205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:53:11.095306 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:11.095284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:53:12.104144 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:12.104100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:12.210651 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:12.210622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:12.300305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:12.300273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:13.247458 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:13.247429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:21.512408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:21.512376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:53:22.769324 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:22.769281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:23.522951 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:23.522914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:29.952634 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:29.952581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:30.097516 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:30.097479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:30.480495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:30.480460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:30.602245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:30.602204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:31.034382 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:31.034348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:31.139001 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:31.138959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:32.744112 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:32.744078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:38.918858 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:38.918825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:53:39.407431 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:39.407392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:39.495182 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:39.495147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:40.086117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:40.086083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:45.960117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:45.960068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:46.061244 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:46.061212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:46.168720 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:46.168686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:46.490172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:46.490131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:47.273960 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:47.273911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:52.544804 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:52.544761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:53.231625 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:53.231592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:53.325503 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:53.325466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:54.070394 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:54.070363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:54.798028 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:54.797997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:55.785221 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:55.785183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:56.756121 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:56.756081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:57.444226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.444194    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:53:57.448599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.448571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:53:57.448754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.448681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.451794 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.451767    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a743146e-serving-cert\""
Sep 16 14:53:57.474001 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.473959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:57.512961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.512909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.513088 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.512964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94r9t\" (UniqueName: \"kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.513088 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.513033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.513208 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.513104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.544506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.544478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:57.613840 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.613811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.613840 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.613842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94r9t\" (UniqueName: \"kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.614089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.613893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.614089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.613923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.614200 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:53:57.614098    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-serving-cert: secret "maas-api-e2e-mt-a743146e-serving-cert" not found
Sep 16 14:53:57.614200 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:53:57.614189    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls podName:9f59cc05-a299-4fe7-b32e-4cb8272cbbed nodeName:}" failed. No retries permitted until 2026-09-16 14:53:58.114166356 +0000 UTC m=+1133.215641804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls") pod "maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" (UID: "9f59cc05-a299-4fe7-b32e-4cb8272cbbed") : secret "maas-api-e2e-mt-a743146e-serving-cert" not found
Sep 16 14:53:57.614563 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.614544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.616302 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.616283    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.623021 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.623000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94r9t\" (UniqueName: \"kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:57.798903 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.798869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:57.954653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:57.954617    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:58.054484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.054392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:58.065525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.065497    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:53:58.069324 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.069301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.072404 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.072383    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a743146e\""
Sep 16 14:53:58.072537 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.072384    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a743146e-dockercfg-m5cvl\""
Sep 16 14:53:58.081990 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.081970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:53:58.119871 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.119842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:58.122360 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.122332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") pod \"maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:58.220767 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.220737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5ll\" (UniqueName: \"kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.220923 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.220794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.322237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.322144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.322384 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.322274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5ll\" (UniqueName: \"kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.322959 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.322916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.330227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.330208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5ll\" (UniqueName: \"kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll\") pod \"payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.364199 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.364174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:53:58.380371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.380347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:58.638200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.638177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:53:58.640203 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:53:58.640176    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f59cc05_a299_4fe7_b32e_4cb8272cbbed.slice/crio-5e03ef58fbea7b8b2cec33a0e199813847bd3f6d892ab1b4ae816a284c4e27d4 WatchSource:0}: Error finding container 5e03ef58fbea7b8b2cec33a0e199813847bd3f6d892ab1b4ae816a284c4e27d4: Status 404 returned error can't find the container with id 5e03ef58fbea7b8b2cec33a0e199813847bd3f6d892ab1b4ae816a284c4e27d4
Sep 16 14:53:58.667180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:58.667156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:53:58.668306 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:53:58.668281    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a562bd2_c911_4780_993a_8f0e238eabe3.slice/crio-13dfe95e092fddf130353a2a074540ecdaec1967348e14fdac9a9dfce6dba960 WatchSource:0}: Error finding container 13dfe95e092fddf130353a2a074540ecdaec1967348e14fdac9a9dfce6dba960: Status 404 returned error can't find the container with id 13dfe95e092fddf130353a2a074540ecdaec1967348e14fdac9a9dfce6dba960
Sep 16 14:53:59.116361 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.116330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" event={"ID":"8a562bd2-c911-4780-993a-8f0e238eabe3","Type":"ContainerStarted","Data":"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"}
Sep 16 14:53:59.116543 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.116387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" event={"ID":"8a562bd2-c911-4780-993a-8f0e238eabe3","Type":"ContainerStarted","Data":"13dfe95e092fddf130353a2a074540ecdaec1967348e14fdac9a9dfce6dba960"}
Sep 16 14:53:59.116543 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.116500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:53:59.117468 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.117445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" event={"ID":"9f59cc05-a299-4fe7-b32e-4cb8272cbbed","Type":"ContainerStarted","Data":"5e03ef58fbea7b8b2cec33a0e199813847bd3f6d892ab1b4ae816a284c4e27d4"}
Sep 16 14:53:59.142281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.142239    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" podStartSLOduration=1.142225462 podStartE2EDuration="1.142225462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:53:59.141315491 +0000 UTC m=+1134.242790941" watchObservedRunningTime="2026-09-16 14:53:59.142225462 +0000 UTC m=+1134.243700914"
Sep 16 14:53:59.755127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.755095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:53:59.855322 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:53:59.855265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:00.126613 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:00.126574    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" event={"ID":"9f59cc05-a299-4fe7-b32e-4cb8272cbbed","Type":"ContainerStarted","Data":"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"}
Sep 16 14:54:00.126802 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:00.126730    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:54:00.144392 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:00.144345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" podStartSLOduration=2.155835482 podStartE2EDuration="3.144328787s" totalImagesPullingTime="988.493305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:54:00.143080754 +0000 UTC m=+1135.244556209" watchObservedRunningTime="2026-09-16 14:54:00.144328787 +0000 UTC m=+1135.245804239"
Sep 16 14:54:05.746505 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:05.746470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:54:06.137702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:06.137675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:54:06.645489 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:06.645420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:10.129463 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:10.129431    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:54:10.679039 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:10.678999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:20.112989 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:20.112898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:20.842828 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:20.842735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:20.970962 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:20.967368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:21.742471 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:21.742437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:22.662630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:22.662600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:23.251259 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:23.251223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:23.379141 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:23.379105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:23.907061 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:23.907020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:24.002267 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:24.002237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:24.305013 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:24.304980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:24.405544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:24.405513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:25.373116 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:25.373084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:30.111951 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:30.111857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:30.211406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:30.211367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:31.254545 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:31.254510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:32.161166 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:32.161134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:33.070288 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:33.070252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:33.854958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:33.854911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:34.589682 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:34.589648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:35.306118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:35.306074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:36.261085 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:36.261053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:39.115514 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:39.115478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:54:41.362305 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.362272    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:54:41.362715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.362476    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" podUID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" containerName="maas-api" containerID="cri-o://43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2" gracePeriod=30
Sep 16 14:54:41.480870 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.480841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:41.583826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.583790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:54:41.584197 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.584165    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" podUID="8a562bd2-c911-4780-993a-8f0e238eabe3" containerName="payload-pre-processing" containerID="cri-o://5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7" gracePeriod=30
Sep 16 14:54:41.656656 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.656621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:41.713504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.713468    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:54:41.826689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.826656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca\") pod \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") "
Sep 16 14:54:41.826857 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.826766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94r9t\" (UniqueName: \"kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t\") pod \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") "
Sep 16 14:54:41.826857 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.826771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:41.826857 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.826839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") pod \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") "
Sep 16 14:54:41.827065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.826875    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs\") pod \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\" (UID: \"9f59cc05-a299-4fe7-b32e-4cb8272cbbed\") "
Sep 16 14:54:41.827065 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.827049    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f59cc05-a299-4fe7-b32e-4cb8272cbbed" (UID: "9f59cc05-a299-4fe7-b32e-4cb8272cbbed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:41.827307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.827287    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:41.828890 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.828863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f59cc05-a299-4fe7-b32e-4cb8272cbbed" (UID: "9f59cc05-a299-4fe7-b32e-4cb8272cbbed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:54:41.828998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.828955    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9f59cc05-a299-4fe7-b32e-4cb8272cbbed" (UID: "9f59cc05-a299-4fe7-b32e-4cb8272cbbed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:54:41.829048 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.828998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t" (OuterVolumeSpecName: "kube-api-access-94r9t") pod "9f59cc05-a299-4fe7-b32e-4cb8272cbbed" (UID: "9f59cc05-a299-4fe7-b32e-4cb8272cbbed"). InnerVolumeSpecName "kube-api-access-94r9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:41.833901 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.833884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:54:41.927789 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.927722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8x5ll\" (UniqueName: \"kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll\") pod \"8a562bd2-c911-4780-993a-8f0e238eabe3\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") "
Sep 16 14:54:41.927934 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.927818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume\") pod \"8a562bd2-c911-4780-993a-8f0e238eabe3\" (UID: \"8a562bd2-c911-4780-993a-8f0e238eabe3\") "
Sep 16 14:54:41.928069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.928046    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94r9t\" (UniqueName: \"kubernetes.io/projected/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-kube-api-access-94r9t\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:41.928069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.928064    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:41.928220 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.928078    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f59cc05-a299-4fe7-b32e-4cb8272cbbed-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:41.928257 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.928215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a562bd2-c911-4780-993a-8f0e238eabe3" (UID: "8a562bd2-c911-4780-993a-8f0e238eabe3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:41.929774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.929754    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll" (OuterVolumeSpecName: "kube-api-access-8x5ll") pod "8a562bd2-c911-4780-993a-8f0e238eabe3" (UID: "8a562bd2-c911-4780-993a-8f0e238eabe3"). InnerVolumeSpecName "kube-api-access-8x5ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:41.960562 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:41.960520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:42.028681 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.028657    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x5ll\" (UniqueName: \"kubernetes.io/projected/8a562bd2-c911-4780-993a-8f0e238eabe3-kube-api-access-8x5ll\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:42.028681 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.028681    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a562bd2-c911-4780-993a-8f0e238eabe3-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:42.091309 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.091276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:42.351563 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.351530    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a562bd2-c911-4780-993a-8f0e238eabe3" containerID="5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7" exitCode=0
Sep 16 14:54:42.351764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.351581    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"
Sep 16 14:54:42.351764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.351640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" event={"ID":"8a562bd2-c911-4780-993a-8f0e238eabe3","Type":"ContainerDied","Data":"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"}
Sep 16 14:54:42.351764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.351693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5" event={"ID":"8a562bd2-c911-4780-993a-8f0e238eabe3","Type":"ContainerDied","Data":"13dfe95e092fddf130353a2a074540ecdaec1967348e14fdac9a9dfce6dba960"}
Sep 16 14:54:42.351764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.351731    2565 scope.go:117] "RemoveContainer" containerID="5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"
Sep 16 14:54:42.353690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.353624    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" containerID="43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2" exitCode=0
Sep 16 14:54:42.353690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.353672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"
Sep 16 14:54:42.353883 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.353675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" event={"ID":"9f59cc05-a299-4fe7-b32e-4cb8272cbbed","Type":"ContainerDied","Data":"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"}
Sep 16 14:54:42.353883 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.353810    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6" event={"ID":"9f59cc05-a299-4fe7-b32e-4cb8272cbbed","Type":"ContainerDied","Data":"5e03ef58fbea7b8b2cec33a0e199813847bd3f6d892ab1b4ae816a284c4e27d4"}
Sep 16 14:54:42.362827 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.362810    2565 scope.go:117] "RemoveContainer" containerID="5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"
Sep 16 14:54:42.363183 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:54:42.363126    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7\": container with ID starting with 5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7 not found: ID does not exist" containerID="5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"
Sep 16 14:54:42.363183 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.363149    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7"} err="failed to get container status \"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7\": rpc error: code = NotFound desc = could not find container \"5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7\": container with ID starting with 5afcd7b965c16e76c11d24e1b163f4efd6b28287688736844cded5ecc988eaf7 not found: ID does not exist"
Sep 16 14:54:42.363183 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.363168    2565 scope.go:117] "RemoveContainer" containerID="43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"
Sep 16 14:54:42.371701 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.371682    2565 scope.go:117] "RemoveContainer" containerID="43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"
Sep 16 14:54:42.371982 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:54:42.371964    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2\": container with ID starting with 43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2 not found: ID does not exist" containerID="43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"
Sep 16 14:54:42.372035 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.371991    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2"} err="failed to get container status \"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2\": rpc error: code = NotFound desc = could not find container \"43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2\": container with ID starting with 43f013c02ba88e2e474b7fbc84b39b757bd2bf0edacef9f609b1f6009ed6f0c2 not found: ID does not exist"
Sep 16 14:54:42.384304 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.384281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:42.390280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.390259    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:54:42.398311 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.398283    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a743146e-6bdb4586d7-7kzf6"]
Sep 16 14:54:42.418210 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.418191    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:54:42.428658 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.428631    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5"]
Sep 16 14:54:42.710032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:42.709920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:43.487169 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:43.487136    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a562bd2-c911-4780-993a-8f0e238eabe3" path="/var/lib/kubelet/pods/8a562bd2-c911-4780-993a-8f0e238eabe3/volumes"
Sep 16 14:54:43.487705 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:43.487684    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" path="/var/lib/kubelet/pods/9f59cc05-a299-4fe7-b32e-4cb8272cbbed/volumes"
Sep 16 14:54:43.582337 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:43.582306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:44.553032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:44.552990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:45.410015 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:45.409977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:46.460385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:46.460352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:47.243870 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:47.243832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:47.991130 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:47.991092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:48.180272 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:48.180232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:49.321860 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:49.321820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:49.493823 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:49.493788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:49.603691 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:49.603597    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:49.995162 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:49.995053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:50.099955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:50.099917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:50.252022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:50.251980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:51.158520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:51.158469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:52.594379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:52.594350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.209484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.209454    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:54:53.209793 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.209718    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" podUID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" containerName="maas-api" containerID="cri-o://afe3c16097cd80aa2b04a0335e3f6e8c51ba43e25d79279783e52efdcc8e24de" gracePeriod=30
Sep 16 14:54:53.253830 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.253798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.273868 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.273837    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:54:53.274154 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.274122    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" podUID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" containerName="payload-processing" containerID="cri-o://48396740ed291e379b1d353a9299275c9d9a8b9a660d23416659791af2deeda7" gracePeriod=30
Sep 16 14:54:53.284285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.284258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:54:53.284483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.284459    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" podUID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" containerName="payload-pre-processing" containerID="cri-o://e48830bf3c47109fd7fd842f5720b0369132907357c0f5adab9edb19d6528a21" gracePeriod=30
Sep 16 14:54:53.355831 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.355798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.416435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.416399    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" containerID="afe3c16097cd80aa2b04a0335e3f6e8c51ba43e25d79279783e52efdcc8e24de" exitCode=0
Sep 16 14:54:53.416616 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.416548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" event={"ID":"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577","Type":"ContainerDied","Data":"afe3c16097cd80aa2b04a0335e3f6e8c51ba43e25d79279783e52efdcc8e24de"}
Sep 16 14:54:53.418262 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.418236    2565 generic.go:356] "Generic (PLEG): container finished" podID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" containerID="e48830bf3c47109fd7fd842f5720b0369132907357c0f5adab9edb19d6528a21" exitCode=0
Sep 16 14:54:53.418394 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.418303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" event={"ID":"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29","Type":"ContainerDied","Data":"e48830bf3c47109fd7fd842f5720b0369132907357c0f5adab9edb19d6528a21"}
Sep 16 14:54:53.421163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.420125    2565 generic.go:356] "Generic (PLEG): container finished" podID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" containerID="48396740ed291e379b1d353a9299275c9d9a8b9a660d23416659791af2deeda7" exitCode=0
Sep 16 14:54:53.421163 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.420180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" event={"ID":"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f","Type":"ContainerDied","Data":"48396740ed291e379b1d353a9299275c9d9a8b9a660d23416659791af2deeda7"}
Sep 16 14:54:53.461082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.461016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.548497 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.548407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:53.585075 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.585045    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:54:53.588340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.588315    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:54:53.592087 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.592026    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:54:53.734970 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.734870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs\") pod \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") "
Sep 16 14:54:53.734970 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.734907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") pod \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.734972    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh5rx\" (UniqueName: \"kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx\") pod \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlz65\" (UniqueName: \"kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65\") pod \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735067    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca\") pod \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume\") pod \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\" (UID: \"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735155    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume\") pod \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\" (UID: \"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29\") "
Sep 16 14:54:53.735465 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccrzp\" (UniqueName: \"kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp\") pod \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\" (UID: \"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577\") "
Sep 16 14:54:53.735779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" (UID: "8b85c4e4-e803-4feb-bc5d-6a29a471dc3f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:53.735779 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735648    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" (UID: "376bdd4d-270f-4a5b-9acc-6b2d89e9dc29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:53.735882 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.735816    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" (UID: "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:54:53.737198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.737179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" (UID: "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:54:53.737432 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.737412    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" (UID: "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:54:53.737479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.737439    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65" (OuterVolumeSpecName: "kube-api-access-zlz65") pod "376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" (UID: "376bdd4d-270f-4a5b-9acc-6b2d89e9dc29"). InnerVolumeSpecName "kube-api-access-zlz65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:53.737623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.737594    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx" (OuterVolumeSpecName: "kube-api-access-zh5rx") pod "8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" (UID: "8b85c4e4-e803-4feb-bc5d-6a29a471dc3f"). InnerVolumeSpecName "kube-api-access-zh5rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:53.737623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.737599    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp" (OuterVolumeSpecName: "kube-api-access-ccrzp") pod "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" (UID: "3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577"). InnerVolumeSpecName "kube-api-access-ccrzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:54:53.836466 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836434    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlz65\" (UniqueName: \"kubernetes.io/projected/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-kube-api-access-zlz65\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836466 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836461    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836474    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836488    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836499    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccrzp\" (UniqueName: \"kubernetes.io/projected/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-kube-api-access-ccrzp\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836510    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836522    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.836640 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.836532    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh5rx\" (UniqueName: \"kubernetes.io/projected/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f-kube-api-access-zh5rx\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:54:53.918040 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:53.918004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:54.045825 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.045795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:54.427059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.426975    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"
Sep 16 14:54:54.427059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.426999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh" event={"ID":"3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577","Type":"ContainerDied","Data":"0812175f3df7411e2f482e7b25dcb1defe2aff66d846ba3bee63870d918d7274"}
Sep 16 14:54:54.427059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.427052    2565 scope.go:117] "RemoveContainer" containerID="afe3c16097cd80aa2b04a0335e3f6e8c51ba43e25d79279783e52efdcc8e24de"
Sep 16 14:54:54.428472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.428452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm" event={"ID":"376bdd4d-270f-4a5b-9acc-6b2d89e9dc29","Type":"ContainerDied","Data":"b0391f4c49fcac63406de94bb219d856b45f8cbb05883ed7e824a9bbe4b0b430"}
Sep 16 14:54:54.428599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.428456    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"
Sep 16 14:54:54.429979 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.429953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7" event={"ID":"8b85c4e4-e803-4feb-bc5d-6a29a471dc3f","Type":"ContainerDied","Data":"ed3b9a9ced00446b370e905ea224cecb2633b764b1df75dff837178d8f524064"}
Sep 16 14:54:54.430127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.429979    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"
Sep 16 14:54:54.437652 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.437638    2565 scope.go:117] "RemoveContainer" containerID="e48830bf3c47109fd7fd842f5720b0369132907357c0f5adab9edb19d6528a21"
Sep 16 14:54:54.447573 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.447557    2565 scope.go:117] "RemoveContainer" containerID="48396740ed291e379b1d353a9299275c9d9a8b9a660d23416659791af2deeda7"
Sep 16 14:54:54.458310 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.458284    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:54:54.464435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.464414    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-230a34-765856df6-2hbsh"]
Sep 16 14:54:54.479896 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.479875    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:54:54.487984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.487959    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7"]
Sep 16 14:54:54.498330 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.498308    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:54:54.512079 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.512059    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm"]
Sep 16 14:54:54.680280 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:54.680199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:55.493285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:55.493252    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" path="/var/lib/kubelet/pods/376bdd4d-270f-4a5b-9acc-6b2d89e9dc29/volumes"
Sep 16 14:54:55.493643 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:55.493628    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" path="/var/lib/kubelet/pods/3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577/volumes"
Sep 16 14:54:55.493931 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:55.493918    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" path="/var/lib/kubelet/pods/8b85c4e4-e803-4feb-bc5d-6a29a471dc3f/volumes"
Sep 16 14:54:55.820226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:55.820188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:56.546400 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:56.546357    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:57.048037 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:57.048003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:57.182849 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:57.182816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:57.296303 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:57.296267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:57.418480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:57.418372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:58.282744 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:58.282709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:58.931036 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:58.930993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:54:59.139574 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:54:59.139541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:00.465353 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:00.465321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:01.025418 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:01.025384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:55:02.604550 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:02.604514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:02.754472 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:02.754437    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:03.598819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:03.598779    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:03.668767 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:03.668740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:04.547182 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.547144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:04.825426 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825333    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 14:55:04.825957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825918    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" containerName="payload-processing"
Sep 16 14:55:04.825957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825953    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" containerName="payload-processing"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825974    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a562bd2-c911-4780-993a-8f0e238eabe3" containerName="payload-pre-processing"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825982    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a562bd2-c911-4780-993a-8f0e238eabe3" containerName="payload-pre-processing"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.825996    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" containerName="maas-api"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826005    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" containerName="maas-api"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826043    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" containerName="payload-pre-processing"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826052    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" containerName="payload-pre-processing"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826062    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" containerName="maas-api"
Sep 16 14:55:04.826125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826070    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" containerName="maas-api"
Sep 16 14:55:04.826448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826160    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="376bdd4d-270f-4a5b-9acc-6b2d89e9dc29" containerName="payload-pre-processing"
Sep 16 14:55:04.826448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826173    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a562bd2-c911-4780-993a-8f0e238eabe3" containerName="payload-pre-processing"
Sep 16 14:55:04.826448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826184    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f59cc05-a299-4fe7-b32e-4cb8272cbbed" containerName="maas-api"
Sep 16 14:55:04.826448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826194    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f58e8f4-5ed5-478f-a4ed-c9ed33f3b577" containerName="maas-api"
Sep 16 14:55:04.826448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.826204    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b85c4e4-e803-4feb-bc5d-6a29a471dc3f" containerName="payload-processing"
Sep 16 14:55:04.829710 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.829690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.833212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.833191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-05b216-openshift-default-dockercfg-lgr68\""
Sep 16 14:55:04.843310 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.843289    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 14:55:04.853555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.853529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:04.937164 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5ln\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937326 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937510 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937510 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:04.937510 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:04.937460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5ln\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038810 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038888 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.038991 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.038970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.039444 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.039423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.040574 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.040548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.040998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.040979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.050234 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.050192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5ln\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.053371 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.053346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token\") pod \"e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") " pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.140155 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.140065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:05.187751 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.187677    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:05.413132 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.413057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:55:05.416676 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.416650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 14:55:05.422999 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.422975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 14:55:05.425408 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:05.425384    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecf5033_5908_45a1_9061_7cbd1ed647af.slice/crio-30078d306f0d2cad48069a58d8ecca3f39eade4d7ea742257fd280efd878595a WatchSource:0}: Error finding container 30078d306f0d2cad48069a58d8ecca3f39eade4d7ea742257fd280efd878595a: Status 404 returned error can't find the container with id 30078d306f0d2cad48069a58d8ecca3f39eade4d7ea742257fd280efd878595a
Sep 16 14:55:05.427448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.427413    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:05.427551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.427490    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:05.427551 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.427531    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:05.499295 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.499256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerStarted","Data":"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"}
Sep 16 14:55:05.499403 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.499346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerStarted","Data":"30078d306f0d2cad48069a58d8ecca3f39eade4d7ea742257fd280efd878595a"}
Sep 16 14:55:05.523444 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:05.523063    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podStartSLOduration=1.523044488 podStartE2EDuration="1.523044488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:05.520384412 +0000 UTC m=+1200.621859865" watchObservedRunningTime="2026-09-16 14:55:05.523044488 +0000 UTC m=+1200.624519941"
Sep 16 14:55:06.140443 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:06.140413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:06.146483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:06.146456    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:06.504342 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:06.504312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:06.505192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:06.505171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:07.091490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:07.091452    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:07.594411 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:07.594375    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:08.154825 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:08.154787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:08.336877 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:08.336840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:09.282861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:09.282815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:10.108534 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:10.108499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:11.366791 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:11.366747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.111904 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.111874    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 14:55:12.117108 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.117084    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.119773 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.119755    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-05b216-serving-cert\""
Sep 16 14:55:12.134015 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.133991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 14:55:12.154669 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.154638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.203278 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.203253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.203416 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.203301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4rdc\" (UniqueName: \"kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.203416 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.203334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.203416 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.203363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.249316 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.249284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.304284 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.304253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.304461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.304304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4rdc\" (UniqueName: \"kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.304461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.304333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.304461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.304440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.305198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.305138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.306968 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.306928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.307207 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.307183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.313348 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.313324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4rdc\" (UniqueName: \"kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc\") pod \"maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.430255 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.430160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:12.512841 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.512784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.720148 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.720125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 14:55:12.721959 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:12.721907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf74e108_796e_43db_a8ce_bd5375786221.slice/crio-289b1e2a4360319c30280323ab8f05b2ef4501eb4e2c4fc019fe24a6249a8ef9 WatchSource:0}: Error finding container 289b1e2a4360319c30280323ab8f05b2ef4501eb4e2c4fc019fe24a6249a8ef9: Status 404 returned error can't find the container with id 289b1e2a4360319c30280323ab8f05b2ef4501eb4e2c4fc019fe24a6249a8ef9
Sep 16 14:55:12.723315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.723282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.819668 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.819634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:12.841406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.841377    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 14:55:12.846430 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.846409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:12.849044 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.849026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-05b216\""
Sep 16 14:55:12.849139 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.849071    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-05b216-dockercfg-pwhjg\""
Sep 16 14:55:12.856161 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.856138    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 14:55:12.860177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.860155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 14:55:12.860276 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.860255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:12.869140 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.869106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 14:55:12.909555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.909527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:12.909689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.909568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp9v9\" (UniqueName: \"kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:12.909689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.909652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmkf\" (UniqueName: \"kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:12.909777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:12.909732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.010769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.010746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.010968 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.010805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.010968 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.010832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp9v9\" (UniqueName: \"kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.010968 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.010867    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmkf\" (UniqueName: \"kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.011473 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.011448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.011587 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.011569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.020174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.020150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmkf\" (UniqueName: \"kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf\") pod \"payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.020269 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.020207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp9v9\" (UniqueName: \"kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9\") pod \"payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.159889 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.159867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.173787 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.173760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.438340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.437874    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 14:55:13.441075 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:13.441048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2ecc4c_eb8e_4e44_aec2_f4c980d07676.slice/crio-812b215480c719cdb115aeb0d4b1a401dddfbad03080bed693940d5676da0417 WatchSource:0}: Error finding container 812b215480c719cdb115aeb0d4b1a401dddfbad03080bed693940d5676da0417: Status 404 returned error can't find the container with id 812b215480c719cdb115aeb0d4b1a401dddfbad03080bed693940d5676da0417
Sep 16 14:55:13.456637 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.456612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 14:55:13.459818 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:13.459739    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe45875a_02a7_4f38_94b7_c6c9b205e4ff.slice/crio-9d45d7f7ddfa7215a506556d9bac2294a1d395a8779b53e70aab99752f038495 WatchSource:0}: Error finding container 9d45d7f7ddfa7215a506556d9bac2294a1d395a8779b53e70aab99752f038495: Status 404 returned error can't find the container with id 9d45d7f7ddfa7215a506556d9bac2294a1d395a8779b53e70aab99752f038495
Sep 16 14:55:13.543851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.543815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" event={"ID":"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676","Type":"ContainerStarted","Data":"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"}
Sep 16 14:55:13.543991 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.543876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" event={"ID":"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676","Type":"ContainerStarted","Data":"812b215480c719cdb115aeb0d4b1a401dddfbad03080bed693940d5676da0417"}
Sep 16 14:55:13.544214 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.544189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:13.545881 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.545852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" event={"ID":"bf74e108-796e-43db-a8ce-bd5375786221","Type":"ContainerStarted","Data":"30715b46a8671d65f46ffa55ccb4590c217b382881cb25976f0a5a9198b4b1eb"}
Sep 16 14:55:13.546029 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.545892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" event={"ID":"bf74e108-796e-43db-a8ce-bd5375786221","Type":"ContainerStarted","Data":"289b1e2a4360319c30280323ab8f05b2ef4501eb4e2c4fc019fe24a6249a8ef9"}
Sep 16 14:55:13.546029 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.545931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:13.551192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.550898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" event={"ID":"be45875a-02a7-4f38-94b7-c6c9b205e4ff","Type":"ContainerStarted","Data":"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"}
Sep 16 14:55:13.551192 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.550980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" event={"ID":"be45875a-02a7-4f38-94b7-c6c9b205e4ff","Type":"ContainerStarted","Data":"9d45d7f7ddfa7215a506556d9bac2294a1d395a8779b53e70aab99752f038495"}
Sep 16 14:55:13.551627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.551416    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:13.566315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.566269    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" podStartSLOduration=1.566251405 podStartE2EDuration="1.566251405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:13.563293619 +0000 UTC m=+1208.664769073" watchObservedRunningTime="2026-09-16 14:55:13.566251405 +0000 UTC m=+1208.667726858"
Sep 16 14:55:13.584881 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.584832    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" podStartSLOduration=1.584814011 podStartE2EDuration="1.584814011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:13.583286057 +0000 UTC m=+1208.684761492" watchObservedRunningTime="2026-09-16 14:55:13.584814011 +0000 UTC m=+1208.686289465"
Sep 16 14:55:13.607676 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:13.607635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" podStartSLOduration=1.23961255 podStartE2EDuration="1.607622597s" totalImagesPullingTime="368.010047ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:13.605242428 +0000 UTC m=+1208.706717879" watchObservedRunningTime="2026-09-16 14:55:13.607622597 +0000 UTC m=+1208.709098049"
Sep 16 14:55:15.297723 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:15.297689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:17.689056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:17.689019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:19.564052 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:19.564024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 14:55:24.561361 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:24.561319    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 14:55:25.566066 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:25.566028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 14:55:25.741400 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:25.741367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:29.639217 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.639181    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerID="064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242" exitCode=0
Sep 16 14:55:29.639629 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.639253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerDied","Data":"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"}
Sep 16 14:55:29.639675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.639633    2565 scope.go:117] "RemoveContainer" containerID="064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"
Sep 16 14:55:29.640675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.640648    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:29.640731 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.640718    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:29.640766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:29.640753    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:55:30.646770 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:30.646737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerStarted","Data":"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"}
Sep 16 14:55:31.140548 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:31.140514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:31.140746 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:31.140725    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 14:55:31.140797 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:31.140780    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 14:55:32.140447 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:32.140413    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 14:55:32.140823 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:32.140469    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 14:55:33.140770 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:33.140734    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 14:55:33.141202 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:33.140788    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 14:55:34.140901 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:34.140862    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 14:55:34.141328 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:34.140928    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 14:55:34.249159 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:34.249113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:35.140539 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:35.140503    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 16 14:55:35.140713 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:35.140557    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 16 14:55:35.536492 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:35.536455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:35.778316 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:35.778277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:35.954749 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:35.954646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:36.145114 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.145088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:36.145689 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.145666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:36.146426 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.146405    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 14:55:36.171183 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.171154    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:55:36.171416 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.171382    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" containerID="cri-o://208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5" gracePeriod=30
Sep 16 14:55:36.224343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.224268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:36.521669 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.521633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:36.713961 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:36.713915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:37.003247 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:37.003211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:37.979520 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:37.979488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:38.081453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:38.081415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:38.250466 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:38.250430    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:38.368285 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:38.368251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:38.463354 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:38.463315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:38.825180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:38.825149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:55:39.018253 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:39.018219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:39.120233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:39.120161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:39.286203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:39.286164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:39.490185 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:39.490093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:41.048560 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.048520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:41.096998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.096962    2565 patch_prober.go:28] interesting pod/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 14:55:41.097149 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.097023    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 14:55:41.420871 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.420851    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:55:41.586691 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.586851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.586851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586740    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.586851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.586851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586822    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.587069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5njs\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.587069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586896    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.587069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.587069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.586973    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data\") pod \"d63d51c4-3f47-4ffe-9030-81238e140319\" (UID: \"d63d51c4-3f47-4ffe-9030-81238e140319\") "
Sep 16 14:55:41.587275 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:55:41.587275 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:55:41.587379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data" (OuterVolumeSpecName: "istio-data") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:55:41.587379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587357    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.587379 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587377    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.587525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587407    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:55:41.587525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.587482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:55:41.589064 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.589005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token" (OuterVolumeSpecName: "istio-token") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:55:41.589232 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.589214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs" (OuterVolumeSpecName: "kube-api-access-p5njs") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "kube-api-access-p5njs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:55:41.589294 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.589261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 14:55:41.589349 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.589287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d63d51c4-3f47-4ffe-9030-81238e140319" (UID: "d63d51c4-3f47-4ffe-9030-81238e140319"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 14:55:41.688229 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688195    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688229 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688223    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d63d51c4-3f47-4ffe-9030-81238e140319-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688236    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5njs\" (UniqueName: \"kubernetes.io/projected/d63d51c4-3f47-4ffe-9030-81238e140319-kube-api-access-p5njs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688249    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688260    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d63d51c4-3f47-4ffe-9030-81238e140319-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688271    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.688419 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.688281    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d63d51c4-3f47-4ffe-9030-81238e140319-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:55:41.718332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.718298    2565 generic.go:356] "Generic (PLEG): container finished" podID="d63d51c4-3f47-4ffe-9030-81238e140319" containerID="208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5" exitCode=0
Sep 16 14:55:41.718479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.718349    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"
Sep 16 14:55:41.718479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.718380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerDied","Data":"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"}
Sep 16 14:55:41.718479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.718438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll" event={"ID":"d63d51c4-3f47-4ffe-9030-81238e140319","Type":"ContainerDied","Data":"698010b2d2356137b2eaa3073d0cdc1613d01d913583de7c79096ac78c716d25"}
Sep 16 14:55:41.718995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.718466    2565 scope.go:117] "RemoveContainer" containerID="208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"
Sep 16 14:55:41.728276 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.728258    2565 scope.go:117] "RemoveContainer" containerID="ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"
Sep 16 14:55:41.736126 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.736109    2565 scope.go:117] "RemoveContainer" containerID="208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"
Sep 16 14:55:41.736371 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:55:41.736351    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5\": container with ID starting with 208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5 not found: ID does not exist" containerID="208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"
Sep 16 14:55:41.736420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.736379    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5"} err="failed to get container status \"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5\": rpc error: code = NotFound desc = could not find container \"208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5\": container with ID starting with 208a2e07505b8f24fb324b47dc8107060c0f9dba50540ccdb35559261ce615a5 not found: ID does not exist"
Sep 16 14:55:41.736420 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.736396    2565 scope.go:117] "RemoveContainer" containerID="ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"
Sep 16 14:55:41.736644 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:55:41.736627    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2\": container with ID starting with ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2 not found: ID does not exist" containerID="ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"
Sep 16 14:55:41.736685 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.736650    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2"} err="failed to get container status \"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2\": rpc error: code = NotFound desc = could not find container \"ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2\": container with ID starting with ac05c3d6b8f8b38d9c4fb83301cec04c0b1deb42684ec371414f9d8eb9ca18d2 not found: ID does not exist"
Sep 16 14:55:41.760012 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.759976    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:55:41.770341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:41.770316    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll"]
Sep 16 14:55:42.527504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:42.527468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:42.629343 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:42.629294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:43.338117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:43.338081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:43.488906 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:43.488874    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" path="/var/lib/kubelet/pods/d63d51c4-3f47-4ffe-9030-81238e140319/volumes"
Sep 16 14:55:43.656464 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:43.656354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:44.469505 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:44.469468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:46.271253 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:46.271218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:46.371212 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:46.371184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:47.145995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.145966    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 14:55:47.146373 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.146361    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.146373 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.146374    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.146493 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.146459    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.150952 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.150911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.157955 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.155581    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-ba69d2-serving-cert\""
Sep 16 14:55:47.162309 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.162280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 14:55:47.240256 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.240228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.240256 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.240264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.240478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.240320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.240478 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.240406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsf8p\" (UniqueName: \"kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.340840 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.340808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.341331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.340851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.341331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.340889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.341331 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.340976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsf8p\" (UniqueName: \"kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.341331 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:55:47.341032    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-serving-cert: secret "maas-api-e2e-shared-b-w2-ba69d2-serving-cert" not found
Sep 16 14:55:47.341331 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:55:47.341115    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls podName:877d70c8-7004-4afb-b30c-b6e33258d1d5 nodeName:}" failed. No retries permitted until 2026-09-16 14:55:47.841099108 +0000 UTC m=+1242.942574543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls") pod "maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" (UID: "877d70c8-7004-4afb-b30c-b6e33258d1d5") : secret "maas-api-e2e-shared-b-w2-ba69d2-serving-cert" not found
Sep 16 14:55:47.341671 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.341647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.343245 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.343224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.356623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.356603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsf8p\" (UniqueName: \"kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.846872 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.846841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.849147 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.849118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:47.918085 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.918055    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 14:55:47.918479 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.918466    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.918528 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.918480    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.918568 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.918548    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d63d51c4-3f47-4ffe-9030-81238e140319" containerName="istio-proxy"
Sep 16 14:55:47.921790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.921774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:47.925175 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.925153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ba69d2-dockercfg-b9g62\""
Sep 16 14:55:47.925447 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.925429    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ba69d2\""
Sep 16 14:55:47.944398 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.944371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 14:55:47.947541 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.947516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv4v5\" (UniqueName: \"kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:47.947772 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.947746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:47.971861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.971836    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 14:55:47.975454 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:47.975439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.001022 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.000994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 14:55:48.031984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.031960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:48.048675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.048651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv4v5\" (UniqueName: \"kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.048790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.048696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.048790 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.048721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sr55\" (UniqueName: \"kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.048868 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.048798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.049426 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.049409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.065485 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.065463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:48.067493 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.067472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv4v5\" (UniqueName: \"kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5\") pod \"payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.149529 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.149499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.149666 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.149545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sr55\" (UniqueName: \"kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.150973 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.150491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.174997 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.174970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sr55\" (UniqueName: \"kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55\") pod \"payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.232571 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.232547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.290604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.290565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.342172 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.342140    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 14:55:48.525861 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.525835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 14:55:48.527540 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:48.527515    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee055c0_9cd9_42d4_a9b3_95dbb650c432.slice/crio-99ed1767898bbedb6ea847f291769406d8bbdd7ed91e4506dc1135b1d34878ea WatchSource:0}: Error finding container 99ed1767898bbedb6ea847f291769406d8bbdd7ed91e4506dc1135b1d34878ea: Status 404 returned error can't find the container with id 99ed1767898bbedb6ea847f291769406d8bbdd7ed91e4506dc1135b1d34878ea
Sep 16 14:55:48.597418 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.597391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 14:55:48.598635 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:55:48.598600    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ab007c_b2cd_4efb_94f5_3ad6da3bbc6f.slice/crio-22e8433443df94f2749f20d2928344f225e41077fe4c43cdb213d74a2f8e1221 WatchSource:0}: Error finding container 22e8433443df94f2749f20d2928344f225e41077fe4c43cdb213d74a2f8e1221: Status 404 returned error can't find the container with id 22e8433443df94f2749f20d2928344f225e41077fe4c43cdb213d74a2f8e1221
Sep 16 14:55:48.759805 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.759733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" event={"ID":"877d70c8-7004-4afb-b30c-b6e33258d1d5","Type":"ContainerStarted","Data":"58b45f2dc426f26addac33029fbccc1ba7dedbef23a616d3bcbe183778c74ddb"}
Sep 16 14:55:48.761531 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.761504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" event={"ID":"0ee055c0-9cd9-42d4-a9b3-95dbb650c432","Type":"ContainerStarted","Data":"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"}
Sep 16 14:55:48.761704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.761557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" event={"ID":"0ee055c0-9cd9-42d4-a9b3-95dbb650c432","Type":"ContainerStarted","Data":"99ed1767898bbedb6ea847f291769406d8bbdd7ed91e4506dc1135b1d34878ea"}
Sep 16 14:55:48.761704 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.761606    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:48.763233 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.763203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" event={"ID":"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f","Type":"ContainerStarted","Data":"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"}
Sep 16 14:55:48.763332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.763248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" event={"ID":"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f","Type":"ContainerStarted","Data":"22e8433443df94f2749f20d2928344f225e41077fe4c43cdb213d74a2f8e1221"}
Sep 16 14:55:48.763332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.763275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:55:48.793522 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.793438    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" podStartSLOduration=1.793423562 podStartE2EDuration="1.793423562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:48.788822037 +0000 UTC m=+1243.890297489" watchObservedRunningTime="2026-09-16 14:55:48.793423562 +0000 UTC m=+1243.894899015"
Sep 16 14:55:48.820673 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.820631    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" podStartSLOduration=1.820618375 podStartE2EDuration="1.820618375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:48.81805389 +0000 UTC m=+1243.919529353" watchObservedRunningTime="2026-09-16 14:55:48.820618375 +0000 UTC m=+1243.922093828"
Sep 16 14:55:48.928653 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:48.928622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:49.769702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:49.769662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" event={"ID":"877d70c8-7004-4afb-b30c-b6e33258d1d5","Type":"ContainerStarted","Data":"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"}
Sep 16 14:55:49.770100 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:49.769817    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:49.790499 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:49.790456    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" podStartSLOduration=2.037469242 podStartE2EDuration="2.790442472s" totalImagesPullingTime="752.97323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:55:49.789700541 +0000 UTC m=+1244.891175994" watchObservedRunningTime="2026-09-16 14:55:49.790442472 +0000 UTC m=+1244.891917925"
Sep 16 14:55:55.780818 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:55.780788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 14:55:55.859438 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:55.859399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:55.957454 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:55.957412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:55:59.772118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:59.772039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 14:55:59.772118 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:55:59.772104    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 14:56:01.264027 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:01.263991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:56:02.207157 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:02.207121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:08.964206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:08.964168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:10.325715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:10.325681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:11.309890 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:11.309851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:12.573259 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:12.573222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:13.664722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:13.664684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:15.109635 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:15.109593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:16.297299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:16.297258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:17.979174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:17.979139    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7673-86f654"]
Sep 16 14:56:17.989274 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:17.989244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:17.999164 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:17.999138    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6cz7\""
Sep 16 14:56:18.001075 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.001051    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-86f654"]
Sep 16 14:56:18.018770 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.018743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:18.127615 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.127591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2xz\" (UniqueName: \"kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz\") pod \"test-curl-7673-86f654\" (UID: \"dc9adee2-0b3b-45b5-bcc9-204f718c435f\") " pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:18.227688 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.227657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:18.228159 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.228138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2xz\" (UniqueName: \"kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz\") pod \"test-curl-7673-86f654\" (UID: \"dc9adee2-0b3b-45b5-bcc9-204f718c435f\") " pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:18.252687 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.252657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2xz\" (UniqueName: \"kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz\") pod \"test-curl-7673-86f654\" (UID: \"dc9adee2-0b3b-45b5-bcc9-204f718c435f\") " pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:18.301892 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.301865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:18.600764 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.600734    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-86f654"]
Sep 16 14:56:18.601308 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:56:18.601286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc9adee2_0b3b_45b5_bcc9_204f718c435f.slice/crio-641894cc221a3c07aacb25ae85274fe53c92a83fbbf0568fe3e7fd22a6e4a571 WatchSource:0}: Error finding container 641894cc221a3c07aacb25ae85274fe53c92a83fbbf0568fe3e7fd22a6e4a571: Status 404 returned error can't find the container with id 641894cc221a3c07aacb25ae85274fe53c92a83fbbf0568fe3e7fd22a6e4a571
Sep 16 14:56:18.922930 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.922844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-86f654" event={"ID":"dc9adee2-0b3b-45b5-bcc9-204f718c435f","Type":"ContainerStarted","Data":"c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6"}
Sep 16 14:56:18.922930 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:18.922886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-86f654" event={"ID":"dc9adee2-0b3b-45b5-bcc9-204f718c435f","Type":"ContainerStarted","Data":"641894cc221a3c07aacb25ae85274fe53c92a83fbbf0568fe3e7fd22a6e4a571"}
Sep 16 14:56:19.627035 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:19.627005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:19.955498 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:19.955391    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7673-86f654" podStartSLOduration=2.95537806 podStartE2EDuration="2.95537806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:18.955237705 +0000 UTC m=+1274.056713160" watchObservedRunningTime="2026-09-16 14:56:19.95537806 +0000 UTC m=+1275.056853512"
Sep 16 14:56:19.956806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:19.956781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7673-86f654"]
Sep 16 14:56:19.965712 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:19.965684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7673-86f654"]
Sep 16 14:56:20.122690 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.122653    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7673-63904d"]
Sep 16 14:56:20.123128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.123113    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" containerName="test-curl-7673-86f654"
Sep 16 14:56:20.123181 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.123129    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" containerName="test-curl-7673-86f654"
Sep 16 14:56:20.123214 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.123208    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" containerName="test-curl-7673-86f654"
Sep 16 14:56:20.126318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.126302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:20.139158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.139134    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-63904d"]
Sep 16 14:56:20.245063 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.244989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mtf\" (UniqueName: \"kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf\") pod \"test-curl-7673-63904d\" (UID: \"11cbcace-2d47-4924-b660-fa5539fb5751\") " pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:20.345485 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.345452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mtf\" (UniqueName: \"kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf\") pod \"test-curl-7673-63904d\" (UID: \"11cbcace-2d47-4924-b660-fa5539fb5751\") " pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:20.362910 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.362879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mtf\" (UniqueName: \"kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf\") pod \"test-curl-7673-63904d\" (UID: \"11cbcace-2d47-4924-b660-fa5539fb5751\") " pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:20.435585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.435558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:20.728432 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.728401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-63904d"]
Sep 16 14:56:20.729914 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:56:20.729891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11cbcace_2d47_4924_b660_fa5539fb5751.slice/crio-042612699b22d017239803d37466603a211aca0e1f11800bc4006ece5a08ffda WatchSource:0}: Error finding container 042612699b22d017239803d37466603a211aca0e1f11800bc4006ece5a08ffda: Status 404 returned error can't find the container with id 042612699b22d017239803d37466603a211aca0e1f11800bc4006ece5a08ffda
Sep 16 14:56:20.930491 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.930461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:20.934812 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.934785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-63904d" event={"ID":"11cbcace-2d47-4924-b660-fa5539fb5751","Type":"ContainerStarted","Data":"e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593"}
Sep 16 14:56:20.934960 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.934827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-63904d" event={"ID":"11cbcace-2d47-4924-b660-fa5539fb5751","Type":"ContainerStarted","Data":"042612699b22d017239803d37466603a211aca0e1f11800bc4006ece5a08ffda"}
Sep 16 14:56:20.934960 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.934861    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7673-86f654" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" containerName="test-curl-7673-86f654" containerID="cri-o://c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6" gracePeriod=2
Sep 16 14:56:20.940581 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:20.940556    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-86f654\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:20.969498 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:20.969455    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7673-63904d" podStartSLOduration=0.969437055 podStartE2EDuration="969.437055ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:20.969384069 +0000 UTC m=+1276.070859521" watchObservedRunningTime="2026-09-16 14:56:20.969437055 +0000 UTC m=+1276.070912507"
Sep 16 14:56:20.972454 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:20.972429    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-86f654\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:21.924604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:21.924521    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7673-63904d"]
Sep 16 14:56:21.933327 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:21.933302    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7673-63904d"]
Sep 16 14:56:21.942000 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:21.941974    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7673-63904d" container="test-curl-7673-63904d"
Sep 16 14:56:22.058912 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.058880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7673-4f697a"]
Sep 16 14:56:22.059372 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.059358    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" containerName="test-curl-7673-63904d"
Sep 16 14:56:22.059417 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.059373    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" containerName="test-curl-7673-63904d"
Sep 16 14:56:22.059457 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.059452    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" containerName="test-curl-7673-63904d"
Sep 16 14:56:22.062470 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.062454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:22.081311 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.081286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-4f697a"]
Sep 16 14:56:22.163599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.163567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5c7\" (UniqueName: \"kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7\") pod \"test-curl-7673-4f697a\" (UID: \"0c1808ca-86d2-4d42-ac63-7a3581d22439\") " pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:22.219642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.219569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:22.264880 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.264850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5c7\" (UniqueName: \"kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7\") pod \"test-curl-7673-4f697a\" (UID: \"0c1808ca-86d2-4d42-ac63-7a3581d22439\") " pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:22.283525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.283498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5c7\" (UniqueName: \"kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7\") pod \"test-curl-7673-4f697a\" (UID: \"0c1808ca-86d2-4d42-ac63-7a3581d22439\") " pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:22.371410 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.371382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:22.659077 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.659022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-4f697a"]
Sep 16 14:56:22.661358 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:56:22.661328    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c1808ca_86d2_4d42_ac63_7a3581d22439.slice/crio-4078944b0947a00c33c245e268a250cfd76835b6a9a760112bc8f80d427010f5 WatchSource:0}: Error finding container 4078944b0947a00c33c245e268a250cfd76835b6a9a760112bc8f80d427010f5: Status 404 returned error can't find the container with id 4078944b0947a00c33c245e268a250cfd76835b6a9a760112bc8f80d427010f5
Sep 16 14:56:22.949817 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.949789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-4f697a" event={"ID":"0c1808ca-86d2-4d42-ac63-7a3581d22439","Type":"ContainerStarted","Data":"84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796"}
Sep 16 14:56:22.950201 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.949829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-4f697a" event={"ID":"0c1808ca-86d2-4d42-ac63-7a3581d22439","Type":"ContainerStarted","Data":"4078944b0947a00c33c245e268a250cfd76835b6a9a760112bc8f80d427010f5"}
Sep 16 14:56:22.950452 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.949903    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7673-63904d" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" containerName="test-curl-7673-63904d" containerID="cri-o://e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593" gracePeriod=2
Sep 16 14:56:22.993276 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:22.993233    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7673-4f697a" podStartSLOduration=0.993216519 podStartE2EDuration="993.216519ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:22.992409656 +0000 UTC m=+1278.093885108" watchObservedRunningTime="2026-09-16 14:56:22.993216519 +0000 UTC m=+1278.094691971"
Sep 16 14:56:22.999131 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:22.999102    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-63904d\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:23.006496 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:23.006469    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-63904d\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:23.120462 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.120435    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:23.123561 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:23.123533    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-63904d\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:23.274307 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.274279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls2xz\" (UniqueName: \"kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz\") pod \"dc9adee2-0b3b-45b5-bcc9-204f718c435f\" (UID: \"dc9adee2-0b3b-45b5-bcc9-204f718c435f\") "
Sep 16 14:56:23.276151 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.276127    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz" (OuterVolumeSpecName: "kube-api-access-ls2xz") pod "dc9adee2-0b3b-45b5-bcc9-204f718c435f" (UID: "dc9adee2-0b3b-45b5-bcc9-204f718c435f"). InnerVolumeSpecName "kube-api-access-ls2xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:23.375755 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.375722    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls2xz\" (UniqueName: \"kubernetes.io/projected/dc9adee2-0b3b-45b5-bcc9-204f718c435f-kube-api-access-ls2xz\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:23.415925 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.415895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:23.488953 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.488913    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" path="/var/lib/kubelet/pods/dc9adee2-0b3b-45b5-bcc9-204f718c435f/volumes"
Sep 16 14:56:23.672044 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.671958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:56:23.788355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.788326    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7673-4f697a"]
Sep 16 14:56:23.797216 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.797192    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7673-4f697a"]
Sep 16 14:56:23.924692 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.924616    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7673-7f3b37"]
Sep 16 14:56:23.925064 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.925049    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" containerName="test-curl-7673-4f697a"
Sep 16 14:56:23.925116 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.925065    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" containerName="test-curl-7673-4f697a"
Sep 16 14:56:23.925158 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.925152    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" containerName="test-curl-7673-4f697a"
Sep 16 14:56:23.928395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.928380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:23.946475 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.946453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-7f3b37"]
Sep 16 14:56:23.959717 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.959687    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc9adee2-0b3b-45b5-bcc9-204f718c435f" containerID="c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6" exitCode=137
Sep 16 14:56:23.960127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.959724    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-86f654"
Sep 16 14:56:23.960127 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.959785    2565 scope.go:117] "RemoveContainer" containerID="c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6"
Sep 16 14:56:23.960127 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:23.960005    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7673-4f697a" container="test-curl-7673-4f697a"
Sep 16 14:56:23.968702 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.968690    2565 scope.go:117] "RemoveContainer" containerID="c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6"
Sep 16 14:56:23.969021 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:23.968997    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6\": container with ID starting with c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6 not found: ID does not exist" containerID="c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6"
Sep 16 14:56:23.969112 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:23.969030    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6"} err="failed to get container status \"c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6\": rpc error: code = NotFound desc = could not find container \"c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6\": container with ID starting with c985545089c293198d047d9514cd68d855994cd16edfc4658a8cb064773259a6 not found: ID does not exist"
Sep 16 14:56:24.082069 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.082038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc\") pod \"test-curl-7673-7f3b37\" (UID: \"dd277626-e2de-45f7-96e8-b38c9cefd79a\") " pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:24.183070 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.182991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc\") pod \"test-curl-7673-7f3b37\" (UID: \"dd277626-e2de-45f7-96e8-b38c9cefd79a\") " pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:24.195341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.195314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc\") pod \"test-curl-7673-7f3b37\" (UID: \"dd277626-e2de-45f7-96e8-b38c9cefd79a\") " pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:24.237001 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.236969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:24.561721 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.561697    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7673-7f3b37"]
Sep 16 14:56:24.563884 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:56:24.563847    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd277626_e2de_45f7_96e8_b38c9cefd79a.slice/crio-8c36e05a4bce44c422a4c69f07321c2749daec7c5fe6551232f3aa37eb30a700 WatchSource:0}: Error finding container 8c36e05a4bce44c422a4c69f07321c2749daec7c5fe6551232f3aa37eb30a700: Status 404 returned error can't find the container with id 8c36e05a4bce44c422a4c69f07321c2749daec7c5fe6551232f3aa37eb30a700
Sep 16 14:56:24.795585 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.795546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:24.967542 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.967513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-7f3b37" event={"ID":"dd277626-e2de-45f7-96e8-b38c9cefd79a","Type":"ContainerStarted","Data":"40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9"}
Sep 16 14:56:24.967847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.967560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7673-7f3b37" event={"ID":"dd277626-e2de-45f7-96e8-b38c9cefd79a","Type":"ContainerStarted","Data":"8c36e05a4bce44c422a4c69f07321c2749daec7c5fe6551232f3aa37eb30a700"}
Sep 16 14:56:24.967847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:24.967651    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7673-4f697a" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" containerName="test-curl-7673-4f697a" containerID="cri-o://84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796" gracePeriod=2
Sep 16 14:56:25.022497 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:25.022461    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-4f697a\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:25.022497 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.022439    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7673-7f3b37" podStartSLOduration=2.022418287 podStartE2EDuration="2.022418287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:25.020032496 +0000 UTC m=+1280.121507951" watchObservedRunningTime="2026-09-16 14:56:25.022418287 +0000 UTC m=+1280.123893740"
Sep 16 14:56:25.125058 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.125032    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:25.129296 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:25.129260    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-4f697a\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:25.292851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.292820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6mtf\" (UniqueName: \"kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf\") pod \"11cbcace-2d47-4924-b660-fa5539fb5751\" (UID: \"11cbcace-2d47-4924-b660-fa5539fb5751\") "
Sep 16 14:56:25.294859 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.294836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf" (OuterVolumeSpecName: "kube-api-access-f6mtf") pod "11cbcace-2d47-4924-b660-fa5539fb5751" (UID: "11cbcace-2d47-4924-b660-fa5539fb5751"). InnerVolumeSpecName "kube-api-access-f6mtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:25.393627 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.393598    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6mtf\" (UniqueName: \"kubernetes.io/projected/11cbcace-2d47-4924-b660-fa5539fb5751-kube-api-access-f6mtf\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:25.488243 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.488210    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11cbcace-2d47-4924-b660-fa5539fb5751" path="/var/lib/kubelet/pods/11cbcace-2d47-4924-b660-fa5539fb5751/volumes"
Sep 16 14:56:25.494523 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:25.494497    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-4f697a\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:25.902665 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.902574    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7673-7f3b37"]
Sep 16 14:56:25.904586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.904559    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:56:25.904777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.904756    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" podUID="0865420d-184f-428d-946f-44379d8a798a" containerName="maas-api" containerID="cri-o://451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93" gracePeriod=30
Sep 16 14:56:25.940765 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.940728    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7673-7f3b37"]
Sep 16 14:56:25.975891 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.975828    2565 generic.go:356] "Generic (PLEG): container finished" podID="11cbcace-2d47-4924-b660-fa5539fb5751" containerID="e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593" exitCode=137
Sep 16 14:56:25.976380 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.975894    2565 scope.go:117] "RemoveContainer" containerID="e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593"
Sep 16 14:56:25.976380 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.976119    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-63904d"
Sep 16 14:56:25.976380 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:25.976225    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7673-7f3b37" container="test-curl-7673-7f3b37"
Sep 16 14:56:25.982469 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:25.982438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:26.016144 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.016125    2565 scope.go:117] "RemoveContainer" containerID="e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593"
Sep 16 14:56:26.016494 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:26.016476    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593\": container with ID starting with e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593 not found: ID does not exist" containerID="e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593"
Sep 16 14:56:26.016544 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.016502    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593"} err="failed to get container status \"e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593\": rpc error: code = NotFound desc = could not find container \"e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593\": container with ID starting with e2d44ea619ba4f8a9fd8accc6e806c25968a12f66b5452f31b64199e51f53593 not found: ID does not exist"
Sep 16 14:56:26.182654 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.182630    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:56:26.204566 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.204523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:26.300772 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.300739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7f8b\" (UniqueName: \"kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b\") pod \"0865420d-184f-428d-946f-44379d8a798a\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") "
Sep 16 14:56:26.300992 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.300784    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls\") pod \"0865420d-184f-428d-946f-44379d8a798a\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") "
Sep 16 14:56:26.300992 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.300829    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs\") pod \"0865420d-184f-428d-946f-44379d8a798a\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") "
Sep 16 14:56:26.300992 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.300860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca\") pod \"0865420d-184f-428d-946f-44379d8a798a\" (UID: \"0865420d-184f-428d-946f-44379d8a798a\") "
Sep 16 14:56:26.301300 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.301269    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0865420d-184f-428d-946f-44379d8a798a" (UID: "0865420d-184f-428d-946f-44379d8a798a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:56:26.303001 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.302976    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0865420d-184f-428d-946f-44379d8a798a" (UID: "0865420d-184f-428d-946f-44379d8a798a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:26.303110 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.303045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b" (OuterVolumeSpecName: "kube-api-access-r7f8b") pod "0865420d-184f-428d-946f-44379d8a798a" (UID: "0865420d-184f-428d-946f-44379d8a798a"). InnerVolumeSpecName "kube-api-access-r7f8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:26.303110 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.303077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0865420d-184f-428d-946f-44379d8a798a" (UID: "0865420d-184f-428d-946f-44379d8a798a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:26.402453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.402418    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7f8b\" (UniqueName: \"kubernetes.io/projected/0865420d-184f-428d-946f-44379d8a798a-kube-api-access-r7f8b\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:26.402453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.402444    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:26.402453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.402454    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0865420d-184f-428d-946f-44379d8a798a-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:26.402453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.402461    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0865420d-184f-428d-946f-44379d8a798a-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:26.505395 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.505355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:26.733055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.733020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:26.983200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.983172    2565 generic.go:356] "Generic (PLEG): container finished" podID="0865420d-184f-428d-946f-44379d8a798a" containerID="451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93" exitCode=0
Sep 16 14:56:26.983549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.983218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"
Sep 16 14:56:26.983549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.983254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" event={"ID":"0865420d-184f-428d-946f-44379d8a798a","Type":"ContainerDied","Data":"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"}
Sep 16 14:56:26.983549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.983306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq" event={"ID":"0865420d-184f-428d-946f-44379d8a798a","Type":"ContainerDied","Data":"78cec0926eec9624e2d70efe373c547db72d3f9c2b09190305d11c137d862fb3"}
Sep 16 14:56:26.983549 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.983328    2565 scope.go:117] "RemoveContainer" containerID="451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"
Sep 16 14:56:26.984527 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.984487    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7673-7f3b37" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" containerName="test-curl-7673-7f3b37" containerID="cri-o://40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9" gracePeriod=2
Sep 16 14:56:26.995651 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:26.995627    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-7f3b37\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:26.996362 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:26.996332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:27.036752 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:27.036724    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-7f3b37\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:27.039229 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.039191    2565 scope.go:117] "RemoveContainer" containerID="451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"
Sep 16 14:56:27.039480 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:27.039459    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93\": container with ID starting with 451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93 not found: ID does not exist" containerID="451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"
Sep 16 14:56:27.039566 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.039486    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93"} err="failed to get container status \"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93\": rpc error: code = NotFound desc = could not find container \"451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93\": container with ID starting with 451b137f8bce857b53353efe7672ae6d160245c8fa1341a442ad02a675f12e93 not found: ID does not exist"
Sep 16 14:56:27.089441 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.089406    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:56:27.111728 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.111700    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-78e52a-649b6ccfb4-fbdqq"]
Sep 16 14:56:27.190920 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.190890    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:27.194156 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:27.194131    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-7f3b37\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:27.214424 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 14:56:27.214842 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214829    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0865420d-184f-428d-946f-44379d8a798a" containerName="maas-api"
Sep 16 14:56:27.214892 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214844    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0865420d-184f-428d-946f-44379d8a798a" containerName="maas-api"
Sep 16 14:56:27.214892 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214859    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" containerName="test-curl-7673-7f3b37"
Sep 16 14:56:27.214892 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" containerName="test-curl-7673-7f3b37"
Sep 16 14:56:27.215019 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214952    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" containerName="test-curl-7673-7f3b37"
Sep 16 14:56:27.215019 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.214961    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0865420d-184f-428d-946f-44379d8a798a" containerName="maas-api"
Sep 16 14:56:27.217918 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.217900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.221127 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:27.221070    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7673-7f3b37\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:27.221227 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.221209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-adb97937-openshift-default-dockercfg-lw2xg\""
Sep 16 14:56:27.242299 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.242273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:27.257215 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.257155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 14:56:27.311066 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311043    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r5c7\" (UniqueName: \"kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7\") pod \"0c1808ca-86d2-4d42-ac63-7a3581d22439\" (UID: \"0c1808ca-86d2-4d42-ac63-7a3581d22439\") "
Sep 16 14:56:27.311236 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311283 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311332 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311372 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311409 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311484 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311530 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311566 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvl4w\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.311604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.311568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.313119 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.313094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7" (OuterVolumeSpecName: "kube-api-access-2r5c7") pod "0c1808ca-86d2-4d42-ac63-7a3581d22439" (UID: "0c1808ca-86d2-4d42-ac63-7a3581d22439"). InnerVolumeSpecName "kube-api-access-2r5c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:27.366703 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.366654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:27.413082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvl4w\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413235 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413446 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413412    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r5c7\" (UniqueName: \"kubernetes.io/projected/0c1808ca-86d2-4d42-ac63-7a3581d22439-kube-api-access-2r5c7\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:27.413694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413629    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413811 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.413866 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.413829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.414082 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.414062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.415766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.415744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.415836 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.415814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.433513 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.433478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.433619 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.433548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvl4w\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w\") pod \"e2e-mt-adb97937-openshift-default-789597df96-x767q\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") " pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.496200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.489635    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0865420d-184f-428d-946f-44379d8a798a" path="/var/lib/kubelet/pods/0865420d-184f-428d-946f-44379d8a798a/volumes"
Sep 16 14:56:27.496200 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.490162    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1808ca-86d2-4d42-ac63-7a3581d22439" path="/var/lib/kubelet/pods/0c1808ca-86d2-4d42-ac63-7a3581d22439/volumes"
Sep 16 14:56:27.527578 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.527544    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:27.606558 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.606523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:27.840495 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.840471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 14:56:27.842416 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:56:27.842393    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a49d67c_48ab_47f7_95b1_c42bb39c1065.slice/crio-650a953b37231065738c44a615bd8b2c1ae7e09ef6e98ea4aa4592b4a81c7c62 WatchSource:0}: Error finding container 650a953b37231065738c44a615bd8b2c1ae7e09ef6e98ea4aa4592b4a81c7c62: Status 404 returned error can't find the container with id 650a953b37231065738c44a615bd8b2c1ae7e09ef6e98ea4aa4592b4a81c7c62
Sep 16 14:56:27.844774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.844741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:56:27.844854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.844805    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:56:27.844854 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.844833    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:56:27.992232 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.992196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerStarted","Data":"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"}
Sep 16 14:56:27.992652 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.992261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerStarted","Data":"650a953b37231065738c44a615bd8b2c1ae7e09ef6e98ea4aa4592b4a81c7c62"}
Sep 16 14:56:27.993488 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.993465    2565 generic.go:356] "Generic (PLEG): container finished" podID="0c1808ca-86d2-4d42-ac63-7a3581d22439" containerID="84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796" exitCode=137
Sep 16 14:56:27.993600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.993508    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-4f697a"
Sep 16 14:56:27.993600 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:27.993563    2565 scope.go:117] "RemoveContainer" containerID="84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796"
Sep 16 14:56:28.003356 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:28.003342    2565 scope.go:117] "RemoveContainer" containerID="84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796"
Sep 16 14:56:28.003623 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:28.003604    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796\": container with ID starting with 84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796 not found: ID does not exist" containerID="84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796"
Sep 16 14:56:28.003686 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:28.003629    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796"} err="failed to get container status \"84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796\": rpc error: code = NotFound desc = could not find container \"84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796\": container with ID starting with 84d44fc31d2ae46fd215793a1f9d0e35de8ce8d286fcd337ff0bfec7ab6c0796 not found: ID does not exist"
Sep 16 14:56:28.053680 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:28.053628    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podStartSLOduration=1.053610838 podStartE2EDuration="1.053610838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:56:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:56:28.052127024 +0000 UTC m=+1283.153602479" watchObservedRunningTime="2026-09-16 14:56:28.053610838 +0000 UTC m=+1283.155086290"
Sep 16 14:56:28.527727 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:28.527685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:28.532401 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:28.532371    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:29.002342 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.002317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:29.003355 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.003338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:56:29.072504 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.072469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:29.184003 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.183927    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:29.332483 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.332453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc\") pod \"dd277626-e2de-45f7-96e8-b38c9cefd79a\" (UID: \"dd277626-e2de-45f7-96e8-b38c9cefd79a\") "
Sep 16 14:56:29.334434 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.334412    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc" (OuterVolumeSpecName: "kube-api-access-hn2jc") pod "dd277626-e2de-45f7-96e8-b38c9cefd79a" (UID: "dd277626-e2de-45f7-96e8-b38c9cefd79a"). InnerVolumeSpecName "kube-api-access-hn2jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:29.433318 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.433279    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn2jc\" (UniqueName: \"kubernetes.io/projected/dd277626-e2de-45f7-96e8-b38c9cefd79a-kube-api-access-hn2jc\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:29.487545 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:29.487513    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd277626-e2de-45f7-96e8-b38c9cefd79a" path="/var/lib/kubelet/pods/dd277626-e2de-45f7-96e8-b38c9cefd79a/volumes"
Sep 16 14:56:30.008984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:30.008928    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd277626-e2de-45f7-96e8-b38c9cefd79a" containerID="40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9" exitCode=137
Sep 16 14:56:30.008984 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:30.008980    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7673-7f3b37"
Sep 16 14:56:30.009506 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:30.008984    2565 scope.go:117] "RemoveContainer" containerID="40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9"
Sep 16 14:56:30.017438 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:30.017420    2565 scope.go:117] "RemoveContainer" containerID="40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9"
Sep 16 14:56:30.017735 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:30.017707    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9\": container with ID starting with 40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9 not found: ID does not exist" containerID="40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9"
Sep 16 14:56:30.017780 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:30.017745    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9"} err="failed to get container status \"40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9\": rpc error: code = NotFound desc = could not find container \"40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9\": container with ID starting with 40ea1eaa27cee9d188896937faae71fbe93f151725e512f13df61c5ae8a84fb9 not found: ID does not exist"
Sep 16 14:56:31.430128 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:31.430091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:31.603150 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:31.603105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:32.328392 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:32.328346    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:33.898651 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:33.898613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:34.584041 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:34.584000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:35.686341 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:35.686307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:37.260173 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:37.260138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:37.510675 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:37.510582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:38.583807 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:38.583774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:38.784682 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:38.784645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:39.214424 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:39.214387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:39.407133 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:39.407097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:39.679193 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:39.679159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:39.888117 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:39.888086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:41.909354 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:41.909324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:43.064980 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:43.064947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:44.305474 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:44.305439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:45.562017 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:45.561977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:46.761224 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:46.761188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:48.136907 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:48.136867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:49.442823 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:49.442780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:50.288836 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.288795    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:56:50.289085 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.289057    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" podUID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" containerName="maas-api" containerID="cri-o://97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581" gracePeriod=30
Sep 16 14:56:50.404749 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.404716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:50.559240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.559217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:56:50.633647 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.633608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:50.635614 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.635590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnxgz\" (UniqueName: \"kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz\") pod \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") "
Sep 16 14:56:50.635722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.635632    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca\") pod \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") "
Sep 16 14:56:50.635722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.635681    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs\") pod \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") "
Sep 16 14:56:50.635722 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.635717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") pod \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\" (UID: \"3e5c88da-40ce-47b0-bdf7-de02862fc9ea\") "
Sep 16 14:56:50.636035 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.636011    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e5c88da-40ce-47b0-bdf7-de02862fc9ea" (UID: "3e5c88da-40ce-47b0-bdf7-de02862fc9ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 14:56:50.636131 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.636115    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:50.637806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.637772    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e5c88da-40ce-47b0-bdf7-de02862fc9ea" (UID: "3e5c88da-40ce-47b0-bdf7-de02862fc9ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:50.637806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.637778    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz" (OuterVolumeSpecName: "kube-api-access-jnxgz") pod "3e5c88da-40ce-47b0-bdf7-de02862fc9ea" (UID: "3e5c88da-40ce-47b0-bdf7-de02862fc9ea"). InnerVolumeSpecName "kube-api-access-jnxgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 14:56:50.637994 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.637821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3e5c88da-40ce-47b0-bdf7-de02862fc9ea" (UID: "3e5c88da-40ce-47b0-bdf7-de02862fc9ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 14:56:50.737594 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.737561    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnxgz\" (UniqueName: \"kubernetes.io/projected/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-kube-api-access-jnxgz\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:50.737594 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.737591    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:50.737594 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.737600    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5c88da-40ce-47b0-bdf7-de02862fc9ea-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 14:56:50.835390 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:50.835285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:51.002457 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.002418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:51.132357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.132259    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" containerID="97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581" exitCode=0
Sep 16 14:56:51.132357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.132320    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"
Sep 16 14:56:51.132357 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.132339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" event={"ID":"3e5c88da-40ce-47b0-bdf7-de02862fc9ea","Type":"ContainerDied","Data":"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"}
Sep 16 14:56:51.132586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.132414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf" event={"ID":"3e5c88da-40ce-47b0-bdf7-de02862fc9ea","Type":"ContainerDied","Data":"c2e232e9fb1dce3eaa9b700d05d73d476a48b00c6445277a81e058ef6e6af68f"}
Sep 16 14:56:51.132586 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.132437    2565 scope.go:117] "RemoveContainer" containerID="97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"
Sep 16 14:56:51.142249 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.142231    2565 scope.go:117] "RemoveContainer" containerID="97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"
Sep 16 14:56:51.142501 ip-10-0-136-124 kubenswrapper[2565]: E0916 14:56:51.142483    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581\": container with ID starting with 97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581 not found: ID does not exist" containerID="97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"
Sep 16 14:56:51.142598 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.142506    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581"} err="failed to get container status \"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581\": rpc error: code = NotFound desc = could not find container \"97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581\": container with ID starting with 97ea6589c5b22e2edbe6dce1d5bb67ec5cf6005631fdeab19950beef090bb581 not found: ID does not exist"
Sep 16 14:56:51.174206 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.174180    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:56:51.177053 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.177029    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-e689e5-658966dd99-glxcf"]
Sep 16 14:56:51.327350 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.327305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:51.487851 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.487763    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" path="/var/lib/kubelet/pods/3e5c88da-40ce-47b0-bdf7-de02862fc9ea/volumes"
Sep 16 14:56:51.559453 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:51.559419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:52.141972 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:52.141924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:56:53.273180 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:53.273146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:54.896325 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:54.896293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:56.120457 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:56.120424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:57.489887 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:57.489840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:58.179863 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:58.179731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:56:59.140325 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:56:59.140288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:00.044123 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:00.044079    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 14:57:00.044294 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:00.044167    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 14:57:00.438055 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:00.437966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:00.613435 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:00.613396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:02.134068 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.134031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:02.211923 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.211892    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerID="c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797" exitCode=0
Sep 16 14:57:02.212107 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.211968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerDied","Data":"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"}
Sep 16 14:57:02.212406 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.212388    2565 scope.go:117] "RemoveContainer" containerID="c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"
Sep 16 14:57:02.213623 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.213594    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:02.213694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.213659    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:02.213694 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.213690    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:02.930351 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:02.930318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:03.126198 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.126164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:03.224385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.224308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerStarted","Data":"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"}
Sep 16 14:57:03.522719 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.522685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:03.528398 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.528372    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:57:03.528618 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.528587    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 16 14:57:03.528670 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.528642    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 16 14:57:03.873460 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:03.873373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:04.184826 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:04.184734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:04.528101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:04.528069    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 16 14:57:04.528555 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:04.528126    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 16 14:57:04.597101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:04.597065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:05.256737 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:05.256704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:05.528073 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:05.528000    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 16 14:57:05.528073 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:05.528047    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 16 14:57:06.035911 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:06.035812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:06.528272 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:06.528240    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 16 14:57:06.528630 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:06.528298    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 16 14:57:07.206565 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:07.206531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:07.528373 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:07.528343    2565 patch_prober.go:28] interesting pod/e2e-mt-adb97937-openshift-default-789597df96-x767q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 16 14:57:07.528755 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:07.528422    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 16 14:57:07.546320 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:07.546294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:07.872763 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:07.872659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:08.178445 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:08.178353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:08.350251 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:08.350210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:08.531766 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:08.531739    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:57:08.532281 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:08.532027    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:57:08.532847 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:08.532829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 14:57:09.255774 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:09.255729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:11.162909 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:11.162869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:12.183336 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:12.183304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:13.214226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:13.214188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:13.386340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:13.386307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:14.337336 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:14.337301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:15.327375 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:15.327322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:15.480441 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:15.480402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:15.903049 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:15.903013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:16.048160 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.048126    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 14:57:16.048573 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.048561    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" containerName="maas-api"
Sep 16 14:57:16.048617 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.048576    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" containerName="maas-api"
Sep 16 14:57:16.048660 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.048652    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e5c88da-40ce-47b0-bdf7-de02862fc9ea" containerName="maas-api"
Sep 16 14:57:16.053240 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.053215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.055832 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.055812    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-d28bd5-dockercfg-lrjct\""
Sep 16 14:57:16.056131 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.056108    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-d28bd5\""
Sep 16 14:57:16.069987 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.069960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 14:57:16.096340 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.096314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrq25\" (UniqueName: \"kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.096469 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.096347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.197408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.197327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrq25\" (UniqueName: \"kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.197408 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.197362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.198003 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.197986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.205575 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.205543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrq25\" (UniqueName: \"kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25\") pod \"payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.363489 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.363457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:16.647475 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.647450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 14:57:16.649361 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:57:16.649334    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2446519_913d_4501_bc22_df43ceb3bf5a.slice/crio-8a1461ae8f7a31bc5f7a8b08942ecc024d582bece996357a2f7860edbff4922a WatchSource:0}: Error finding container 8a1461ae8f7a31bc5f7a8b08942ecc024d582bece996357a2f7860edbff4922a: Status 404 returned error can't find the container with id 8a1461ae8f7a31bc5f7a8b08942ecc024d582bece996357a2f7860edbff4922a
Sep 16 14:57:16.899715 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:16.899628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:17.300176 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:17.300144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" event={"ID":"c2446519-913d-4501-bc22-df43ceb3bf5a","Type":"ContainerStarted","Data":"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"}
Sep 16 14:57:17.300396 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:17.300196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" event={"ID":"c2446519-913d-4501-bc22-df43ceb3bf5a","Type":"ContainerStarted","Data":"8a1461ae8f7a31bc5f7a8b08942ecc024d582bece996357a2f7860edbff4922a"}
Sep 16 14:57:17.300396 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:17.300217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:17.352244 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:17.352176    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" podStartSLOduration=1.3521552190000001 podStartE2EDuration="1.352155219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:17.348723629 +0000 UTC m=+1332.450199079" watchObservedRunningTime="2026-09-16 14:57:17.352155219 +0000 UTC m=+1332.453630674"
Sep 16 14:57:24.359415 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:24.359370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:25.553491 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:25.553458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:57:28.308005 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:28.307910    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 14:57:29.414194 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:29.414162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:38.373625 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:38.373585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:39.586433 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:39.586395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:40.579416 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:40.579381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:41.474514 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:41.474477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:42.285448 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:42.285414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:42.505300 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:42.505268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:42.856167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:42.856117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:43.387725 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.387695    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 14:57:43.392050 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.392032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.398114 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.398091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-cadcf4-openshift-default-dockercfg-5jp5d\""
Sep 16 14:57:43.415869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.415847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 14:57:43.427171 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.427142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:43.560628 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglnf\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561014 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.560990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.561244 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.561024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.629399 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.629367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:43.662502 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662642 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.662869 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663059 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.662982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nglnf\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663255 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.663120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.663438 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.663420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.664845 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.664823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.665102 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.665084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.673177 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.673152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.674795 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.674778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglnf\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf\") pod \"e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") " pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.702809 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.702781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:43.731667 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.731639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:43.984092 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.984061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 14:57:43.984871 ip-10-0-136-124 kubenswrapper[2565]: W0916 14:57:43.984850    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf832460b_5e61_4dbf_ada5_4170a55671ca.slice/crio-ae479707114b0bc6bc3a86037f26456b019ca52edfdf0fe448ce37f7cdcbf8ff WatchSource:0}: Error finding container ae479707114b0bc6bc3a86037f26456b019ca52edfdf0fe448ce37f7cdcbf8ff: Status 404 returned error can't find the container with id ae479707114b0bc6bc3a86037f26456b019ca52edfdf0fe448ce37f7cdcbf8ff
Sep 16 14:57:43.987164 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.987128    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:43.987282 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.987207    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:43.987282 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:43.987251    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:57:44.436304 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:44.436268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:44.448337 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:44.448302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerStarted","Data":"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"}
Sep 16 14:57:44.448480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:44.448360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerStarted","Data":"ae479707114b0bc6bc3a86037f26456b019ca52edfdf0fe448ce37f7cdcbf8ff"}
Sep 16 14:57:44.492588 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:44.492535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podStartSLOduration=1.49251968 podStartE2EDuration="1.49251968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 14:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 14:57:44.490322988 +0000 UTC m=+1359.591798442" watchObservedRunningTime="2026-09-16 14:57:44.49251968 +0000 UTC m=+1359.593995132"
Sep 16 14:57:44.703957 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:44.703872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:45.709101 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:45.709070    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:45.784291 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:45.784258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:46.396604 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:46.396567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:46.460346 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:46.460312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:46.461267 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:46.461248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:57:46.494347 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:46.494317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:46.864394 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:46.864356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:47.853249 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:47.853209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:48.882442 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:48.882394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:49.957806 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:49.957769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:51.359480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:51.359442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:52.252505 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:52.252445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:52.379872 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:52.379838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:53.222356 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:53.222315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:53.330075 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:53.330035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:53.430170 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:53.430132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:53.765221 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:53.765184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:53.838807 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:53.838774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:57:54.007480 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:54.007445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:57:54.123377 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:57:54.123306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:17.867398 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:17.867358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:18.656952 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:18.656905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:58:19.134641 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:19.134606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:20.045217 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:20.045178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:21.084167 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:21.084132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:21.558912 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:21.558877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:21.892385 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:21.892296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:22.682777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:22.682743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:23.763096 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:23.763066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:24.530135 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:24.530074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:25.668573 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.668540    2565 generic.go:356] "Generic (PLEG): container finished" podID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerID="275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202" exitCode=0
Sep 16 14:58:25.668933 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.668614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerDied","Data":"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"}
Sep 16 14:58:25.669084 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.669069    2565 scope.go:117] "RemoveContainer" containerID="275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"
Sep 16 14:58:25.670402 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.670372    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:58:25.670490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.670445    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:58:25.670490 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:25.670476    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 14:58:26.111499 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:26.111465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:26.681461 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:26.681429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerStarted","Data":"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"}
Sep 16 14:58:26.702998 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:26.702971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:58:26.703712 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:26.703693    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 16 14:58:26.703754 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:26.703735    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 16 14:58:27.703628 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:27.703594    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 16 14:58:27.704032 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:27.703655    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 16 14:58:28.703569 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:28.703532    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 16 14:58:28.703759 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:28.703599    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 16 14:58:29.704039 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:29.704002    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 16 14:58:29.704424 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:29.704069    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 16 14:58:30.703202 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:30.703167    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 16 14:58:30.703431 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:30.703229    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 16 14:58:31.461203 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:31.461162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:58:31.708275 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:31.708245    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:58:31.710226 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:31.710201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 14:58:43.411819 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:43.411781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:51.803388 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:51.803351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:58:53.531174 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:58:53.531139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:59:02.797525 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:02.797436    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:03.649503 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:03.649470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:04.993531 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:04.993492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:05.197401 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:05.197367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:05.974089 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:05.974054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:06.999062 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:06.999024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:08.314599 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:08.314563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:08.583339 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:08.583256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:09.456645 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:09.456606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:17.997056 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:17.997021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:18.084777 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:18.084739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:18.152451 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:18.152417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:18.267125 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:18.267084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:18.368148 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:18.368115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:18.745769 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:18.745674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:19.671009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:19.670971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:20.579958 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:20.579903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:21.343548 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:21.343503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:21.442266 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:21.442224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:21.633237 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:21.633143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:22.565995 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:22.565962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:23.489973 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:23.489908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:24.460315 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:24.460259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:25.274982 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:25.274950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 14:59:26.587607 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:26.587570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:38.692878 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:38.692839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:59.318850 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:59.318812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 14:59:59.419009 ip-10-0-136-124 kubenswrapper[2565]: I0916 14:59:59.418980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:00.193404 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.193370    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"]
Sep 16 15:00:00.197163 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.197145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"
Sep 16 15:00:00.199996 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.199972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5dqq2\""
Sep 16 15:00:00.207130 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.207102    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"
Sep 16 15:00:00.210627 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.210149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"]
Sep 16 15:00:00.241791 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.241729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:00.495222 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.495196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"]
Sep 16 15:00:00.496288 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:00:00.496263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6158cf0_bd94_4f82_b37a_1e395fe5db57.slice/crio-0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa WatchSource:0}: Error finding container 0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa: Status 404 returned error can't find the container with id 0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa
Sep 16 15:00:00.498131 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:00.498113    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:00:01.199210 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:01.199177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz" event={"ID":"a6158cf0-bd94-4f82-b37a-1e395fe5db57","Type":"ContainerStarted","Data":"0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa"}
Sep 16 15:00:02.654265 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:02.654229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:04.216770 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:04.216740    2565 generic.go:356] "Generic (PLEG): container finished" podID="a6158cf0-bd94-4f82-b37a-1e395fe5db57" containerID="caa9e607386e96cd6a4f8ae5f30e163169d83e66305eab001e98999042413969" exitCode=0
Sep 16 15:00:04.217131 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:04.216831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz" event={"ID":"a6158cf0-bd94-4f82-b37a-1e395fe5db57","Type":"ContainerDied","Data":"caa9e607386e96cd6a4f8ae5f30e163169d83e66305eab001e98999042413969"}
Sep 16 15:00:04.580259 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:04.580226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:05.349191 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:05.349170    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"
Sep 16 15:00:05.449563 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:05.449536    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:00:05.460235 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:05.460210    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:00:06.229901 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:06.229860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz" event={"ID":"a6158cf0-bd94-4f82-b37a-1e395fe5db57","Type":"ContainerDied","Data":"0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa"}
Sep 16 15:00:06.229901 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:06.229901    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"
Sep 16 15:00:06.230126 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:06.229981    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d72a8b9b5eaf990f5ceb91217bb7daef98d118a3b170eb43f495ed1a77559fa"
Sep 16 15:00:07.626308 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:07.626273    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:00:11.494851 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:11.494814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:32.618612 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:32.618530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:00:35.078164 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:35.078127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:41.451927 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:41.451880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:44.863104 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:44.863062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:44.981464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:44.981415    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:45.510279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:45.510238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:45.630949 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:45.630886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:45.787698 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:45.787602    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 15:00:45.788438 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:45.787836    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy" containerID="cri-o://ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052" gracePeriod=30
Sep 16 15:00:45.960835 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:45.960798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:47.186446 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:47.186392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:50.539511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:50.539480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:51.047984 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.047959    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 15:00:51.143345 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143348    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143428    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143455    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143780 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:00:51.143780 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143629    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143780 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143709    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvl4w\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.143780 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs\") pod \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\" (UID: \"6a49d67c-48ab-47f7-95b1-c42bb39c1065\") "
Sep 16 15:00:51.144032 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143817    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:00:51.144032 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.143894    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:00:51.144145 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144111    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:00:51.144145 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:00:51.144258 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144174    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.144258 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144191    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.144258 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144204    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.144258 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.144216    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.145594 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.145565    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:00:51.145712 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.145639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:00:51.146251 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.146231    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:00:51.146350 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.146273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w" (OuterVolumeSpecName: "kube-api-access-xvl4w") pod "6a49d67c-48ab-47f7-95b1-c42bb39c1065" (UID: "6a49d67c-48ab-47f7-95b1-c42bb39c1065"). InnerVolumeSpecName "kube-api-access-xvl4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:00:51.244825 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.244785    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvl4w\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-kube-api-access-xvl4w\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.244825 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.244819    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.244825 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.244832    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.245089 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.244843    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.245089 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.244853    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a49d67c-48ab-47f7-95b1-c42bb39c1065-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:00:51.499599 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.499568    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerID="ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052" exitCode=0
Sep 16 15:00:51.499730 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.499608    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"
Sep 16 15:00:51.499730 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.499644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerDied","Data":"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"}
Sep 16 15:00:51.499730 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.499694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q" event={"ID":"6a49d67c-48ab-47f7-95b1-c42bb39c1065","Type":"ContainerDied","Data":"650a953b37231065738c44a615bd8b2c1ae7e09ef6e98ea4aa4592b4a81c7c62"}
Sep 16 15:00:51.499730 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.499718    2565 scope.go:117] "RemoveContainer" containerID="ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"
Sep 16 15:00:51.508827 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.508809    2565 scope.go:117] "RemoveContainer" containerID="c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"
Sep 16 15:00:51.516810 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.516792    2565 scope.go:117] "RemoveContainer" containerID="ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"
Sep 16 15:00:51.517114 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:00:51.517095    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052\": container with ID starting with ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052 not found: ID does not exist" containerID="ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"
Sep 16 15:00:51.517181 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.517121    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052"} err="failed to get container status \"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052\": rpc error: code = NotFound desc = could not find container \"ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052\": container with ID starting with ee0c627e6ceb13951113236202549355256cd12ac00fef3fdcc6ab67dd0e5052 not found: ID does not exist"
Sep 16 15:00:51.517181 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.517137    2565 scope.go:117] "RemoveContainer" containerID="c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"
Sep 16 15:00:51.517387 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:00:51.517367    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797\": container with ID starting with c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797 not found: ID does not exist" containerID="c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"
Sep 16 15:00:51.517439 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.517396    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797"} err="failed to get container status \"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797\": rpc error: code = NotFound desc = could not find container \"c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797\": container with ID starting with c1738e9b879fb428df4f8b46944334110ac6b41867898c9f53d6937a0344b797 not found: ID does not exist"
Sep 16 15:00:51.521775 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.521751    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 15:00:51.529927 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:51.529908    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q"]
Sep 16 15:00:53.145602 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:53.145562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:53.211675 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:53.211639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:53.487915 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:53.487833    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" path="/var/lib/kubelet/pods/6a49d67c-48ab-47f7-95b1-c42bb39c1065/volumes"
Sep 16 15:00:55.594894 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:55.594859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:55.693999 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:55.693965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:00:56.068981 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:00:56.068950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:01.227741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:01.227706    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:01:03.500394 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:03.500336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:03.619813 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:03.619780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:03.762827 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:03.762741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:13.592549 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:13.592515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:14.197691 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:14.197660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:14.427174 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:14.427137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:16.278449 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:16.278410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:35.296540 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:35.296501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:39.166672 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:39.166639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:39.856236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:39.856194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:01:41.801511 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:41.801468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:41.901711 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:41.901676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:42.138247 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.138207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:42.434705 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.434622    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:01:42.435220 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435200    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6158cf0-bd94-4f82-b37a-1e395fe5db57" containerName="cleanup"
Sep 16 15:01:42.435337 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435222    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6158cf0-bd94-4f82-b37a-1e395fe5db57" containerName="cleanup"
Sep 16 15:01:42.435337 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435255    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:01:42.435337 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435264    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:01:42.435492 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435381    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:01:42.435492 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435396    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:01:42.435492 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.435408    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6158cf0-bd94-4f82-b37a-1e395fe5db57" containerName="cleanup"
Sep 16 15:01:42.438862 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.438842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.441898 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.441877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-079e6e-openshift-default-dockercfg-lrhdv\""
Sep 16 15:01:42.455627 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.455508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:42.457681 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.457650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:01:42.518464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsl6\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.518663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.519001 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.518777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620371 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsl6\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620580 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620951 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620951 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.620951 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.620917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.621183 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.621160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.621257 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.621226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.621308 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.621290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.622963 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.622927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.623184 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.623167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.630052 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.630029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsl6\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.630281 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.630261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token\") pod \"e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") " pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.748852 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.748815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:42.846257 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:42.846220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:43.047408 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:01:43.047374    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8e327c_808a_4750_8295_28e03fb17441.slice/crio-e7e045c77f48d29d2d452bdf4048d06a8746d82df5c1c8ac1f235d9682552448 WatchSource:0}: Error finding container e7e045c77f48d29d2d452bdf4048d06a8746d82df5c1c8ac1f235d9682552448: Status 404 returned error can't find the container with id e7e045c77f48d29d2d452bdf4048d06a8746d82df5c1c8ac1f235d9682552448
Sep 16 15:01:43.049131 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.049104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:01:43.050300 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.050261    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:01:43.050406 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.050345    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:01:43.050406 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.050388    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:01:43.780132 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.780098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerStarted","Data":"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"}
Sep 16 15:01:43.780361 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.780153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerStarted","Data":"e7e045c77f48d29d2d452bdf4048d06a8746d82df5c1c8ac1f235d9682552448"}
Sep 16 15:01:43.828139 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:43.828074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podStartSLOduration=1.828054266 podStartE2EDuration="1.828054266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:01:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:01:43.824141224 +0000 UTC m=+1598.925616676" watchObservedRunningTime="2026-09-16 15:01:43.828054266 +0000 UTC m=+1598.929529718"
Sep 16 15:01:44.749437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:44.749397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:44.755335 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:44.755306    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:44.787266 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:44.787229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:44.788359 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:44.788336    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:01:45.097986 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:45.097873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:45.867268 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:45.867215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:45.966681 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:45.966646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:46.067123 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:46.067087    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:46.979682 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:46.979643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:47.609337 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:47.609297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:48.178221 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:48.178183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:49.279457 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:49.279423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:50.147540 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:50.147500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:50.903357 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:50.903321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:51.782259 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:51.782227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:51.881961 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:51.881911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:52.481424 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:52.481389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:52.612425 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:52.612391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:52.707861 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:52.707827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:53.044428 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:53.044391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:53.959542 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:53.959507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:54.676146 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:54.676111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:55.811837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:55.811805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:56.205587 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:56.205487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:56.299201 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:56.299168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:01:57.665394 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:01:57.665355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:01.332520 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:01.332483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:03.175380 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.175345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:03.333282 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.333239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 15:02:03.333911 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.333835    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" podUID="292612df-614b-4a35-98ff-1b6caf014114" containerName="maas-api" containerID="cri-o://7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f" gracePeriod=30
Sep 16 15:02:03.477471 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.477431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:03.598900 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.598874    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 15:02:03.638106 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.638069    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") pod \"292612df-614b-4a35-98ff-1b6caf014114\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") "
Sep 16 15:02:03.638106 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.638111    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca\") pod \"292612df-614b-4a35-98ff-1b6caf014114\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") "
Sep 16 15:02:03.638363 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.638203    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs\") pod \"292612df-614b-4a35-98ff-1b6caf014114\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") "
Sep 16 15:02:03.638363 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.638265    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvmsz\" (UniqueName: \"kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz\") pod \"292612df-614b-4a35-98ff-1b6caf014114\" (UID: \"292612df-614b-4a35-98ff-1b6caf014114\") "
Sep 16 15:02:03.638524 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.638495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "292612df-614b-4a35-98ff-1b6caf014114" (UID: "292612df-614b-4a35-98ff-1b6caf014114"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:02:03.640678 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.640649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz" (OuterVolumeSpecName: "kube-api-access-kvmsz") pod "292612df-614b-4a35-98ff-1b6caf014114" (UID: "292612df-614b-4a35-98ff-1b6caf014114"). InnerVolumeSpecName "kube-api-access-kvmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:02:03.640804 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.640726    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "292612df-614b-4a35-98ff-1b6caf014114" (UID: "292612df-614b-4a35-98ff-1b6caf014114"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:02:03.640990 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.640961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "292612df-614b-4a35-98ff-1b6caf014114" (UID: "292612df-614b-4a35-98ff-1b6caf014114"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:02:03.739623 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.739524    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvmsz\" (UniqueName: \"kubernetes.io/projected/292612df-614b-4a35-98ff-1b6caf014114-kube-api-access-kvmsz\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:02:03.739623 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.739558    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:02:03.739623 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.739567    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292612df-614b-4a35-98ff-1b6caf014114-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:02:03.739623 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.739576    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292612df-614b-4a35-98ff-1b6caf014114-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:02:03.893537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.893501    2565 generic.go:356] "Generic (PLEG): container finished" podID="292612df-614b-4a35-98ff-1b6caf014114" containerID="7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f" exitCode=0
Sep 16 15:02:03.893721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.893550    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"
Sep 16 15:02:03.893721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.893593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" event={"ID":"292612df-614b-4a35-98ff-1b6caf014114","Type":"ContainerDied","Data":"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"}
Sep 16 15:02:03.893721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.893653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd" event={"ID":"292612df-614b-4a35-98ff-1b6caf014114","Type":"ContainerDied","Data":"429a0630c60f85346be1408663ce3664c2c6a8de47787bd4091784dd5d7dc03f"}
Sep 16 15:02:03.893721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.893676    2565 scope.go:117] "RemoveContainer" containerID="7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"
Sep 16 15:02:03.906086 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.906057    2565 scope.go:117] "RemoveContainer" containerID="7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"
Sep 16 15:02:03.906436 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:02:03.906418    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f\": container with ID starting with 7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f not found: ID does not exist" containerID="7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"
Sep 16 15:02:03.906523 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.906443    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f"} err="failed to get container status \"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f\": rpc error: code = NotFound desc = could not find container \"7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f\": container with ID starting with 7acf981c0c86cb1e8ff164e77ef2f6291a699a455d72d2f9676a0d6571ee2e2f not found: ID does not exist"
Sep 16 15:02:03.919178 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.919150    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 15:02:03.923304 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:03.923277    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-780e10-77d876b75b-xh7kd"]
Sep 16 15:02:04.119122 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:04.119064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:04.217784 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:04.217750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:05.421053 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:05.421021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:05.491571 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:05.491540    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292612df-614b-4a35-98ff-1b6caf014114" path="/var/lib/kubelet/pods/292612df-614b-4a35-98ff-1b6caf014114/volumes"
Sep 16 15:02:06.016360 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:06.016325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:07.627389 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:07.627350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:07.883645 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:07.883528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:08.753958 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:08.753899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:10.342876 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:10.342846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:10.446851 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:10.446820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:10.710820 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:10.710744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:10.891294 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:10.891261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:11.001865 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:11.001821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:11.183803 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:11.183756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:11.296781 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:11.296695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:11.541673 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:11.541639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:11.634234 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:11.634207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:12.024559 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:12.024522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:12.592557 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:12.592500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:13.352222 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:13.352187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:14.147082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.147034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:14.789308 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.789274    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:14.789491 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.789333    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:14.960682 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.960603    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb8e327c-808a-4750-8295-28e03fb17441" containerID="26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162" exitCode=0
Sep 16 15:02:14.960682 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.960668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerDied","Data":"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"}
Sep 16 15:02:14.961056 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.961042    2565 scope.go:117] "RemoveContainer" containerID="26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"
Sep 16 15:02:14.962226 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.962192    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:02:14.962350 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.962279    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:02:14.962350 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.962328    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:02:14.977808 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:14.977780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:15.089783 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:15.089651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:15.183454 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:15.183419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:15.973209 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:15.973161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerStarted","Data":"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"}
Sep 16 15:02:16.111514 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:16.111472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:16.373015 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:16.372971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:16.749786 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:16.749757    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:02:16.749978 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:16.749919    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:16.750055 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:16.750010    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:17.205506 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:17.205399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:17.749573 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:17.749538    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:17.750020 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:17.749596    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:18.277251 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.277211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:18.367178 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.367137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:18.467768 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.467734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:18.749587 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.749556    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:18.750100 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.749616    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:18.803841 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.803806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:18.895591 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:18.895561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:19.255666 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:19.255629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:19.749818 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:19.749788    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:19.750353 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:19.749848    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:20.021966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:20.021852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:20.749910 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:20.749871    2565 patch_prober.go:28] interesting pod/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Sep 16 15:02:20.750433 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:20.749977    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Sep 16 15:02:20.999301 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:20.999260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:21.696967 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:21.696900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:21.755820 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:21.755782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:02:21.756261 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:21.756156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:02:21.757149 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:21.757128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:02:22.546731 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:22.546689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:28.743146 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:28.743106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:28.842304 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:28.842270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:30.200068 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:30.200034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:33.921950 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:33.921904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:02:36.552436 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:36.552391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:37.112377 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:37.112343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:39.214098 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:39.214064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:40.738249 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:40.738202    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:41.626977 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:41.626920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:42.258658 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:42.258620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:43.140485 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:43.140451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:43.879866 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:43.879835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:44.721541 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:44.721502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:45.105287 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:45.105251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:45.551747 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:45.551709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:46.277317 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:46.277281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:48.464391 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:48.464361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:49.353173 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:49.353139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:50.176900 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:50.176870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:50.897930 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:50.897892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:51.796839 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:51.796805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:52.511738 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:52.511685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:53.335099 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:53.335061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:54.097977 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:54.097925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:02:55.029994 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:02:55.029933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:03.421873 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:03.418461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:03:03.878649 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:03.878605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:03.982459 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:03.982416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:04.105785 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:04.105740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:04.206667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:04.206569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:04.487972 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:04.487856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:04.584080 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:04.584044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:05.361689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:05.361646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:06.359247 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:06.359193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:07.601854 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:07.601823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:08.059254 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:08.059222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:08.816435 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:08.816393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:09.354343 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:09.354312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:09.869368 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:09.869324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:10.614915 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:10.614874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:11.392365 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.392332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:11.541979 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.541888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:11.644676 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.644585    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:03:11.644869 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.644842    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy" containerID="cri-o://c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4" gracePeriod=30
Sep 16 15:03:11.647443 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.647417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:11.745714 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:11.745679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:12.565485 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:12.565440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:13.415601 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:13.415559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:13.964289 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:13.964254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:14.256240 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:14.256208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:15.063624 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:15.063591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:16.193627 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.193586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:16.906875 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.906848    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:03:16.972468 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972468 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972442    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972468 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972651    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972737    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.972837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:16.973170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972859    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:16.973170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972875    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grsl6\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6\") pod \"eb8e327c-808a-4750-8295-28e03fb17441\" (UID: \"eb8e327c-808a-4750-8295-28e03fb17441\") "
Sep 16 15:03:16.973170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.972895    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:16.973170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973053    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:16.973170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973099    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:16.973437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973298    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8e327c-808a-4750-8295-28e03fb17441-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:16.973437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973316    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:16.973437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973329    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:16.973437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973342    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:16.973437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.973356    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:16.974717 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.974686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:03:16.974917 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.974898    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:03:16.975087 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.975067    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6" (OuterVolumeSpecName: "kube-api-access-grsl6") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "kube-api-access-grsl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:16.975133 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.975069    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb8e327c-808a-4750-8295-28e03fb17441" (UID: "eb8e327c-808a-4750-8295-28e03fb17441"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:16.982527 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:16.982497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:17.073880 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.073843    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8e327c-808a-4750-8295-28e03fb17441-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:17.073880 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.073874    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:17.073880 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.073882    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8e327c-808a-4750-8295-28e03fb17441-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:17.074143 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.073890    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grsl6\" (UniqueName: \"kubernetes.io/projected/eb8e327c-808a-4750-8295-28e03fb17441-kube-api-access-grsl6\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:17.308136 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.308096    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb8e327c-808a-4750-8295-28e03fb17441" containerID="c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4" exitCode=0
Sep 16 15:03:17.308642 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.308141    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"
Sep 16 15:03:17.308642 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.308154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerDied","Data":"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"}
Sep 16 15:03:17.308642 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.308197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg" event={"ID":"eb8e327c-808a-4750-8295-28e03fb17441","Type":"ContainerDied","Data":"e7e045c77f48d29d2d452bdf4048d06a8746d82df5c1c8ac1f235d9682552448"}
Sep 16 15:03:17.308642 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.308217    2565 scope.go:117] "RemoveContainer" containerID="c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"
Sep 16 15:03:17.318203 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.318182    2565 scope.go:117] "RemoveContainer" containerID="26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"
Sep 16 15:03:17.326414 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.326396    2565 scope.go:117] "RemoveContainer" containerID="c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"
Sep 16 15:03:17.326679 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:03:17.326648    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4\": container with ID starting with c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4 not found: ID does not exist" containerID="c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"
Sep 16 15:03:17.326726 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.326688    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4"} err="failed to get container status \"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4\": rpc error: code = NotFound desc = could not find container \"c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4\": container with ID starting with c89df17693a1e9abd0d9291fb6ae37903d1b2263aa0ddc051638fb00ad2da5a4 not found: ID does not exist"
Sep 16 15:03:17.326726 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.326710    2565 scope.go:117] "RemoveContainer" containerID="26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"
Sep 16 15:03:17.326964 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:03:17.326933    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162\": container with ID starting with 26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162 not found: ID does not exist" containerID="26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"
Sep 16 15:03:17.327020 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.326970    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162"} err="failed to get container status \"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162\": rpc error: code = NotFound desc = could not find container \"26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162\": container with ID starting with 26ad3eba887ddad33d123fa91f090325bdec81ecc2e907597a5f6d843007a162 not found: ID does not exist"
Sep 16 15:03:17.330705 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.330686    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:03:17.338307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.338281    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg"]
Sep 16 15:03:17.488154 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.488123    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8e327c-808a-4750-8295-28e03fb17441" path="/var/lib/kubelet/pods/eb8e327c-808a-4750-8295-28e03fb17441/volumes"
Sep 16 15:03:17.828180 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:17.828152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:18.714834 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:18.714798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:22.145695 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:22.145658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:24.378395 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.378363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:24.410958 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.410168    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 15:03:24.410958 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.410401    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" podUID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" containerName="payload-processing" containerID="cri-o://010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7" gracePeriod=30
Sep 16 15:03:24.682545 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.682516    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 15:03:24.749861 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.749820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume\") pod \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") "
Sep 16 15:03:24.750081 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.749882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tr55\" (UniqueName: \"kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55\") pod \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\" (UID: \"6952f7b8-0e9d-4200-b48b-e8f9210145f3\") "
Sep 16 15:03:24.750281 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.750255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6952f7b8-0e9d-4200-b48b-e8f9210145f3" (UID: "6952f7b8-0e9d-4200-b48b-e8f9210145f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:24.752108 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.752081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55" (OuterVolumeSpecName: "kube-api-access-7tr55") pod "6952f7b8-0e9d-4200-b48b-e8f9210145f3" (UID: "6952f7b8-0e9d-4200-b48b-e8f9210145f3"). InnerVolumeSpecName "kube-api-access-7tr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:24.850612 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.850576    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6952f7b8-0e9d-4200-b48b-e8f9210145f3-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:24.850612 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.850605    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tr55\" (UniqueName: \"kubernetes.io/projected/6952f7b8-0e9d-4200-b48b-e8f9210145f3-kube-api-access-7tr55\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:24.984781 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:24.984689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:25.085105 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.085069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:25.351852 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.351814    2565 generic.go:356] "Generic (PLEG): container finished" podID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" containerID="010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7" exitCode=0
Sep 16 15:03:25.352064 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.351862    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"
Sep 16 15:03:25.352064 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.351904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" event={"ID":"6952f7b8-0e9d-4200-b48b-e8f9210145f3","Type":"ContainerDied","Data":"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"}
Sep 16 15:03:25.352064 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.351994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns" event={"ID":"6952f7b8-0e9d-4200-b48b-e8f9210145f3","Type":"ContainerDied","Data":"5f1208f5490789386f72835d9e59fd56ce48935cca275c0ee24a81bdaca0d48d"}
Sep 16 15:03:25.352064 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.352029    2565 scope.go:117] "RemoveContainer" containerID="010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"
Sep 16 15:03:25.362057 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.362036    2565 scope.go:117] "RemoveContainer" containerID="010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"
Sep 16 15:03:25.362324 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:03:25.362304    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7\": container with ID starting with 010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7 not found: ID does not exist" containerID="010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"
Sep 16 15:03:25.362390 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.362332    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7"} err="failed to get container status \"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7\": rpc error: code = NotFound desc = could not find container \"010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7\": container with ID starting with 010efe6298e05ddd49290b4f1b362631957e8746187ab3ad2fa1d4a4556c60b7 not found: ID does not exist"
Sep 16 15:03:25.376542 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.376518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 15:03:25.383627 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.383598    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns"]
Sep 16 15:03:25.488319 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.488280    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" path="/var/lib/kubelet/pods/6952f7b8-0e9d-4200-b48b-e8f9210145f3/volumes"
Sep 16 15:03:25.885664 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:25.885628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:26.705626 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:26.705589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:27.412830 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:27.412790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:28.252585 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:28.252489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:29.440448 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:29.440414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:29.542476 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:29.542441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:29.794820 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:29.794782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:30.238316 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:30.238228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:30.424498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:30.424463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:03:30.896758 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:30.896722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:31.858874 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:31.858845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:32.160770 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:32.160684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:32.299021 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:32.298987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:32.497554 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:32.497529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:32.664683 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:32.664647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:35.578477 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:35.578435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:35.655040 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:35.655001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:35.907660 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:35.907567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:36.889557 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:36.889514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:37.856025 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:37.855990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:38.856193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:38.856156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:39.606932 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:39.606878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:40.566834 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:40.566802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:42.059444 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:42.059411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.344664 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.344632    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 15:03:47.345086 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.344821    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" podUID="bf74e108-796e-43db-a8ce-bd5375786221" containerName="maas-api" containerID="cri-o://30715b46a8671d65f46ffa55ccb4590c217b382881cb25976f0a5a9198b4b1eb" gracePeriod=30
Sep 16 15:03:47.418560 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.418521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.451868 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.451832    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 15:03:47.452414 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.452129    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" podUID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" containerName="payload-processing" containerID="cri-o://3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8" gracePeriod=30
Sep 16 15:03:47.470342 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.470298    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 15:03:47.470587 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.470555    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" podUID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" containerName="payload-pre-processing" containerID="cri-o://d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7" gracePeriod=30
Sep 16 15:03:47.477405 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.477372    2565 generic.go:356] "Generic (PLEG): container finished" podID="bf74e108-796e-43db-a8ce-bd5375786221" containerID="30715b46a8671d65f46ffa55ccb4590c217b382881cb25976f0a5a9198b4b1eb" exitCode=0
Sep 16 15:03:47.477600 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.477533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" event={"ID":"bf74e108-796e-43db-a8ce-bd5375786221","Type":"ContainerDied","Data":"30715b46a8671d65f46ffa55ccb4590c217b382881cb25976f0a5a9198b4b1eb"}
Sep 16 15:03:47.531487 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.531440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.620183 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.620149    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 15:03:47.646695 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.646647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.737614 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.737589    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 15:03:47.747763 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.747741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 15:03:47.772596 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.772569    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4rdc\" (UniqueName: \"kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc\") pod \"bf74e108-796e-43db-a8ce-bd5375786221\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") "
Sep 16 15:03:47.772742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.772606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs\") pod \"bf74e108-796e-43db-a8ce-bd5375786221\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") "
Sep 16 15:03:47.772742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.772683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca\") pod \"bf74e108-796e-43db-a8ce-bd5375786221\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") "
Sep 16 15:03:47.772742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.772728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls\") pod \"bf74e108-796e-43db-a8ce-bd5375786221\" (UID: \"bf74e108-796e-43db-a8ce-bd5375786221\") "
Sep 16 15:03:47.773122 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.773090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bf74e108-796e-43db-a8ce-bd5375786221" (UID: "bf74e108-796e-43db-a8ce-bd5375786221"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:47.774735 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.774711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bf74e108-796e-43db-a8ce-bd5375786221" (UID: "bf74e108-796e-43db-a8ce-bd5375786221"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:47.774830 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.774739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bf74e108-796e-43db-a8ce-bd5375786221" (UID: "bf74e108-796e-43db-a8ce-bd5375786221"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:03:47.774885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.774851    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc" (OuterVolumeSpecName: "kube-api-access-q4rdc") pod "bf74e108-796e-43db-a8ce-bd5375786221" (UID: "bf74e108-796e-43db-a8ce-bd5375786221"). InnerVolumeSpecName "kube-api-access-q4rdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:47.798391 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.798351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.873286 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume\") pod \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") "
Sep 16 15:03:47.873286 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp9v9\" (UniqueName: \"kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9\") pod \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\" (UID: \"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676\") "
Sep 16 15:03:47.873498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume\") pod \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") "
Sep 16 15:03:47.873498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmkf\" (UniqueName: \"kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf\") pod \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\" (UID: \"be45875a-02a7-4f38-94b7-c6c9b205e4ff\") "
Sep 16 15:03:47.873581 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873569    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.873616 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873588    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4rdc\" (UniqueName: \"kubernetes.io/projected/bf74e108-796e-43db-a8ce-bd5375786221-kube-api-access-q4rdc\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.873616 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873601    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf74e108-796e-43db-a8ce-bd5375786221-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.873689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873615    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf74e108-796e-43db-a8ce-bd5375786221-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.873689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873653    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" (UID: "8f2ecc4c-eb8e-4e44-aec2-f4c980d07676"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:47.873756 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.873653    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "be45875a-02a7-4f38-94b7-c6c9b205e4ff" (UID: "be45875a-02a7-4f38-94b7-c6c9b205e4ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:03:47.875339 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.875321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf" (OuterVolumeSpecName: "kube-api-access-dlmkf") pod "be45875a-02a7-4f38-94b7-c6c9b205e4ff" (UID: "be45875a-02a7-4f38-94b7-c6c9b205e4ff"). InnerVolumeSpecName "kube-api-access-dlmkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:47.875413 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.875396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9" (OuterVolumeSpecName: "kube-api-access-dp9v9") pod "8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" (UID: "8f2ecc4c-eb8e-4e44-aec2-f4c980d07676"). InnerVolumeSpecName "kube-api-access-dp9v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:03:47.896689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.896656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:47.974964 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.974908    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.974964 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.974958    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp9v9\" (UniqueName: \"kubernetes.io/projected/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676-kube-api-access-dp9v9\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.975166 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.974975    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/be45875a-02a7-4f38-94b7-c6c9b205e4ff-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:47.975166 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:47.974989    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmkf\" (UniqueName: \"kubernetes.io/projected/be45875a-02a7-4f38-94b7-c6c9b205e4ff-kube-api-access-dlmkf\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:03:48.343341 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.343307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:48.485201 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.485166    2565 generic.go:356] "Generic (PLEG): container finished" podID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" containerID="3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8" exitCode=0
Sep 16 15:03:48.485671 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.485217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"
Sep 16 15:03:48.485671 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.485251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" event={"ID":"be45875a-02a7-4f38-94b7-c6c9b205e4ff","Type":"ContainerDied","Data":"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"}
Sep 16 15:03:48.485671 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.485293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m" event={"ID":"be45875a-02a7-4f38-94b7-c6c9b205e4ff","Type":"ContainerDied","Data":"9d45d7f7ddfa7215a506556d9bac2294a1d395a8779b53e70aab99752f038495"}
Sep 16 15:03:48.485671 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.485320    2565 scope.go:117] "RemoveContainer" containerID="3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"
Sep 16 15:03:48.486740 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.486699    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" containerID="d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7" exitCode=0
Sep 16 15:03:48.486818 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.486741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"
Sep 16 15:03:48.486818 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.486781    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" event={"ID":"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676","Type":"ContainerDied","Data":"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"}
Sep 16 15:03:48.486924 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.486831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f" event={"ID":"8f2ecc4c-eb8e-4e44-aec2-f4c980d07676","Type":"ContainerDied","Data":"812b215480c719cdb115aeb0d4b1a401dddfbad03080bed693940d5676da0417"}
Sep 16 15:03:48.488314 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.488298    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"
Sep 16 15:03:48.488429 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.488337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw" event={"ID":"bf74e108-796e-43db-a8ce-bd5375786221","Type":"ContainerDied","Data":"289b1e2a4360319c30280323ab8f05b2ef4501eb4e2c4fc019fe24a6249a8ef9"}
Sep 16 15:03:48.495805 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.495790    2565 scope.go:117] "RemoveContainer" containerID="3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"
Sep 16 15:03:48.496108 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:03:48.496088    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8\": container with ID starting with 3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8 not found: ID does not exist" containerID="3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"
Sep 16 15:03:48.496184 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.496115    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8"} err="failed to get container status \"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8\": rpc error: code = NotFound desc = could not find container \"3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8\": container with ID starting with 3d4a5447b176162831b8f113510bbcc688a66f8442fc24360739cbdba55412b8 not found: ID does not exist"
Sep 16 15:03:48.496184 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.496130    2565 scope.go:117] "RemoveContainer" containerID="d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"
Sep 16 15:03:48.504452 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.504434    2565 scope.go:117] "RemoveContainer" containerID="d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"
Sep 16 15:03:48.504714 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:03:48.504696    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7\": container with ID starting with d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7 not found: ID does not exist" containerID="d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"
Sep 16 15:03:48.504775 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.504718    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7"} err="failed to get container status \"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7\": rpc error: code = NotFound desc = could not find container \"d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7\": container with ID starting with d70720a49e8ee590d4c0bd240a05cdef4e924cdbf461b8e1a745f08c11822af7 not found: ID does not exist"
Sep 16 15:03:48.504775 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.504732    2565 scope.go:117] "RemoveContainer" containerID="30715b46a8671d65f46ffa55ccb4590c217b382881cb25976f0a5a9198b4b1eb"
Sep 16 15:03:48.533924 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.533897    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 15:03:48.557589 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.557557    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m"]
Sep 16 15:03:48.574392 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.574365    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 15:03:48.590486 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.590462    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-05b216-79f99584db-r6mqw"]
Sep 16 15:03:48.626272 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.626200    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 15:03:48.648976 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.648934    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f"]
Sep 16 15:03:48.683418 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:48.683387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:49.332409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:49.332373    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:03:49.413964 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:49.413921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:49.488372 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:49.488341    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" path="/var/lib/kubelet/pods/8f2ecc4c-eb8e-4e44-aec2-f4c980d07676/volumes"
Sep 16 15:03:49.488738 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:49.488728    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" path="/var/lib/kubelet/pods/be45875a-02a7-4f38-94b7-c6c9b205e4ff/volumes"
Sep 16 15:03:49.489134 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:49.489113    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf74e108-796e-43db-a8ce-bd5375786221" path="/var/lib/kubelet/pods/bf74e108-796e-43db-a8ce-bd5375786221/volumes"
Sep 16 15:03:50.752304 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:50.752266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:51.690608 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:51.690573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:52.111604 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:52.111567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:52.213143 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:52.213101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:53.353466 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:53.353414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:53.602516 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:53.602484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:54.106422 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:54.106384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:54.868829 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:54.868790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:54.970319 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:54.970286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:55.124263 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:55.124177    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 15:03:55.124437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:55.124410    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy" containerID="cri-o://a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a" gracePeriod=30
Sep 16 15:03:55.143396 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:55.143355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:56.379251 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:56.379220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:57.380657 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:57.380615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:57.959299 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:57.959259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:58.184200 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:58.184165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:59.106381 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:59.106345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:03:59.813684 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:03:59.813649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:00.379122 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.379101    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 15:04:00.484079 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.483986    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w5ln\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484079 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484079 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484071    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484369 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket\") pod \"5ecf5033-5908-45a1-9061-7cbd1ed647af\" (UID: \"5ecf5033-5908-45a1-9061-7cbd1ed647af\") "
Sep 16 15:04:00.484689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:00.484748 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:00.484807 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:00.484898 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:00.484983 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.484616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:04:00.486330 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.486306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:04:00.486330 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.486317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:04:00.486470 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.486306    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:00.486470 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.486366    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln" (OuterVolumeSpecName: "kube-api-access-8w5ln") pod "5ecf5033-5908-45a1-9061-7cbd1ed647af" (UID: "5ecf5033-5908-45a1-9061-7cbd1ed647af"). InnerVolumeSpecName "kube-api-access-8w5ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:00.563067 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.563033    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerID="a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a" exitCode=0
Sep 16 15:04:00.563236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.563081    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"
Sep 16 15:04:00.563236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.563082    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerDied","Data":"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"}
Sep 16 15:04:00.563236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.563197    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m" event={"ID":"5ecf5033-5908-45a1-9061-7cbd1ed647af","Type":"ContainerDied","Data":"30078d306f0d2cad48069a58d8ecca3f39eade4d7ea742257fd280efd878595a"}
Sep 16 15:04:00.563236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.563220    2565 scope.go:117] "RemoveContainer" containerID="a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"
Sep 16 15:04:00.572687 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.572667    2565 scope.go:117] "RemoveContainer" containerID="064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"
Sep 16 15:04:00.580563 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.580544    2565 scope.go:117] "RemoveContainer" containerID="a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"
Sep 16 15:04:00.580823 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:04:00.580806    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a\": container with ID starting with a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a not found: ID does not exist" containerID="a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"
Sep 16 15:04:00.580865 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.580831    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a"} err="failed to get container status \"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a\": rpc error: code = NotFound desc = could not find container \"a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a\": container with ID starting with a80bb3689cb928ab0c161fed52027196a673e236f75e62fe49d68edf90f1976a not found: ID does not exist"
Sep 16 15:04:00.580865 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.580845    2565 scope.go:117] "RemoveContainer" containerID="064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"
Sep 16 15:04:00.581106 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:04:00.581088    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242\": container with ID starting with 064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242 not found: ID does not exist" containerID="064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"
Sep 16 15:04:00.581152 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.581113    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242"} err="failed to get container status \"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242\": rpc error: code = NotFound desc = could not find container \"064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242\": container with ID starting with 064b74bffc996952602042fdc528ab3f6fd74a3cfbca25ab26ff88c2bd9e0242 not found: ID does not exist"
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585571    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w5ln\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-kube-api-access-8w5ln\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585593    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585606    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585614    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585623    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585631    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecf5033-5908-45a1-9061-7cbd1ed647af-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585638    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585645    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.585646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.585652    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecf5033-5908-45a1-9061-7cbd1ed647af-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:00.588600 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.588562    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 15:04:00.592986 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:00.592962    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m"]
Sep 16 15:04:01.487444 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:01.487407    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" path="/var/lib/kubelet/pods/5ecf5033-5908-45a1-9061-7cbd1ed647af/volumes"
Sep 16 15:04:02.210213 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:02.210178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:04:05.971303 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:05.971185    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 15:04:05.971772 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:05.971515    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" podUID="877d70c8-7004-4afb-b30c-b6e33258d1d5" containerName="maas-api" containerID="cri-o://866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430" gracePeriod=30
Sep 16 15:04:05.999643 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:05.999610    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"]
Sep 16 15:04:06.003409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.003376    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-ba69d2-29826180-nv9fz"]
Sep 16 15:04:06.007624 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.007594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:06.035387 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.035354    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 15:04:06.036320 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.036283    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" podUID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" containerName="payload-processing" containerID="cri-o://4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259" gracePeriod=30
Sep 16 15:04:06.047269 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.047239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 15:04:06.047621 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.047595    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" podUID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" containerName="payload-pre-processing" containerID="cri-o://e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed" gracePeriod=30
Sep 16 15:04:06.292501 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.292462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:06.335398 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.335370    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 15:04:06.361485 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.361428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:06.366202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.366179    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 15:04:06.369792 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.369772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 15:04:06.434985 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.434945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") pod \"877d70c8-7004-4afb-b30c-b6e33258d1d5\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") "
Sep 16 15:04:06.435147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume\") pod \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") "
Sep 16 15:04:06.435147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume\") pod \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") "
Sep 16 15:04:06.435147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv4v5\" (UniqueName: \"kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5\") pod \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\" (UID: \"0ee055c0-9cd9-42d4-a9b3-95dbb650c432\") "
Sep 16 15:04:06.435147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsf8p\" (UniqueName: \"kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p\") pod \"877d70c8-7004-4afb-b30c-b6e33258d1d5\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") "
Sep 16 15:04:06.435386 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs\") pod \"877d70c8-7004-4afb-b30c-b6e33258d1d5\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") "
Sep 16 15:04:06.435386 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435226    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca\") pod \"877d70c8-7004-4afb-b30c-b6e33258d1d5\" (UID: \"877d70c8-7004-4afb-b30c-b6e33258d1d5\") "
Sep 16 15:04:06.435386 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sr55\" (UniqueName: \"kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55\") pod \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\" (UID: \"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f\") "
Sep 16 15:04:06.435535 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" (UID: "f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:04:06.435641 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435618    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.435641 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435477    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0ee055c0-9cd9-42d4-a9b3-95dbb650c432" (UID: "0ee055c0-9cd9-42d4-a9b3-95dbb650c432"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:04:06.435915 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.435893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "877d70c8-7004-4afb-b30c-b6e33258d1d5" (UID: "877d70c8-7004-4afb-b30c-b6e33258d1d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:04:06.437224 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.437201    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p" (OuterVolumeSpecName: "kube-api-access-hsf8p") pod "877d70c8-7004-4afb-b30c-b6e33258d1d5" (UID: "877d70c8-7004-4afb-b30c-b6e33258d1d5"). InnerVolumeSpecName "kube-api-access-hsf8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:06.437604 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.437581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "877d70c8-7004-4afb-b30c-b6e33258d1d5" (UID: "877d70c8-7004-4afb-b30c-b6e33258d1d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:04:06.437675 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.437582    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5" (OuterVolumeSpecName: "kube-api-access-rv4v5") pod "0ee055c0-9cd9-42d4-a9b3-95dbb650c432" (UID: "0ee055c0-9cd9-42d4-a9b3-95dbb650c432"). InnerVolumeSpecName "kube-api-access-rv4v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:06.437675 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.437663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "877d70c8-7004-4afb-b30c-b6e33258d1d5" (UID: "877d70c8-7004-4afb-b30c-b6e33258d1d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:04:06.437748 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.437688    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55" (OuterVolumeSpecName: "kube-api-access-6sr55") pod "f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" (UID: "f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f"). InnerVolumeSpecName "kube-api-access-6sr55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:04:06.536343 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536306    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsf8p\" (UniqueName: \"kubernetes.io/projected/877d70c8-7004-4afb-b30c-b6e33258d1d5-kube-api-access-hsf8p\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536343 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536339    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536582 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536353    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/877d70c8-7004-4afb-b30c-b6e33258d1d5-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536582 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536366    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sr55\" (UniqueName: \"kubernetes.io/projected/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f-kube-api-access-6sr55\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536582 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536378    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/877d70c8-7004-4afb-b30c-b6e33258d1d5-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536582 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536390    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.536582 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.536405    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv4v5\" (UniqueName: \"kubernetes.io/projected/0ee055c0-9cd9-42d4-a9b3-95dbb650c432-kube-api-access-rv4v5\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:04:06.596276 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.596236    2565 generic.go:356] "Generic (PLEG): container finished" podID="877d70c8-7004-4afb-b30c-b6e33258d1d5" containerID="866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430" exitCode=0
Sep 16 15:04:06.596460 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.596284    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"
Sep 16 15:04:06.596460 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.596285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" event={"ID":"877d70c8-7004-4afb-b30c-b6e33258d1d5","Type":"ContainerDied","Data":"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"}
Sep 16 15:04:06.596460 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.596340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr" event={"ID":"877d70c8-7004-4afb-b30c-b6e33258d1d5","Type":"ContainerDied","Data":"58b45f2dc426f26addac33029fbccc1ba7dedbef23a616d3bcbe183778c74ddb"}
Sep 16 15:04:06.596460 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.596369    2565 scope.go:117] "RemoveContainer" containerID="866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"
Sep 16 15:04:06.597994 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.597969    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" containerID="e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed" exitCode=0
Sep 16 15:04:06.598099 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.598061    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"
Sep 16 15:04:06.598099 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.598062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" event={"ID":"0ee055c0-9cd9-42d4-a9b3-95dbb650c432","Type":"ContainerDied","Data":"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"}
Sep 16 15:04:06.598233 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.598114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6" event={"ID":"0ee055c0-9cd9-42d4-a9b3-95dbb650c432","Type":"ContainerDied","Data":"99ed1767898bbedb6ea847f291769406d8bbdd7ed91e4506dc1135b1d34878ea"}
Sep 16 15:04:06.599573 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.599548    2565 generic.go:356] "Generic (PLEG): container finished" podID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" containerID="4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259" exitCode=0
Sep 16 15:04:06.599714 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.599596    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"
Sep 16 15:04:06.599714 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.599616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" event={"ID":"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f","Type":"ContainerDied","Data":"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"}
Sep 16 15:04:06.599714 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.599662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5" event={"ID":"f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f","Type":"ContainerDied","Data":"22e8433443df94f2749f20d2928344f225e41077fe4c43cdb213d74a2f8e1221"}
Sep 16 15:04:06.610573 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.610517    2565 scope.go:117] "RemoveContainer" containerID="866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"
Sep 16 15:04:06.610984 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:04:06.610882    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430\": container with ID starting with 866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430 not found: ID does not exist" containerID="866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"
Sep 16 15:04:06.610984 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.610908    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430"} err="failed to get container status \"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430\": rpc error: code = NotFound desc = could not find container \"866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430\": container with ID starting with 866aae52850805323d9850e9057093bd14dda772a7fcb257a6a97d37cddd8430 not found: ID does not exist"
Sep 16 15:04:06.610984 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.610928    2565 scope.go:117] "RemoveContainer" containerID="e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"
Sep 16 15:04:06.619179 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.619161    2565 scope.go:117] "RemoveContainer" containerID="e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"
Sep 16 15:04:06.619439 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:04:06.619421    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed\": container with ID starting with e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed not found: ID does not exist" containerID="e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"
Sep 16 15:04:06.619502 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.619445    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed"} err="failed to get container status \"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed\": rpc error: code = NotFound desc = could not find container \"e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed\": container with ID starting with e8271b49ddea58cf3000cafb3f9f19590e48aca2f9ce442f6593192aa858afed not found: ID does not exist"
Sep 16 15:04:06.619502 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.619463    2565 scope.go:117] "RemoveContainer" containerID="4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"
Sep 16 15:04:06.624958 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.624922    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 15:04:06.627418 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.627402    2565 scope.go:117] "RemoveContainer" containerID="4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"
Sep 16 15:04:06.627654 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:04:06.627633    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259\": container with ID starting with 4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259 not found: ID does not exist" containerID="4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"
Sep 16 15:04:06.627721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.627662    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259"} err="failed to get container status \"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259\": rpc error: code = NotFound desc = could not find container \"4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259\": container with ID starting with 4901bfcefcee83919679b24880d7d4e5172a42aacadb5aa77bdf32319b787259 not found: ID does not exist"
Sep 16 15:04:06.628968 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.628949    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ba69d2-767b88598c-ld7lr"]
Sep 16 15:04:06.640091 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.640067    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 15:04:06.646216 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.646197    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6"]
Sep 16 15:04:06.658550 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.658525    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 15:04:06.663932 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.663909    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5"]
Sep 16 15:04:06.819323 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.819244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:06.921491 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:06.921460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:07.370816 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:07.370781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:07.488036 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:07.488004    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" path="/var/lib/kubelet/pods/0ee055c0-9cd9-42d4-a9b3-95dbb650c432/volumes"
Sep 16 15:04:07.488435 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:07.488421    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="877d70c8-7004-4afb-b30c-b6e33258d1d5" path="/var/lib/kubelet/pods/877d70c8-7004-4afb-b30c-b6e33258d1d5/volumes"
Sep 16 15:04:07.488682 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:07.488672    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6158cf0-bd94-4f82-b37a-1e395fe5db57" path="/var/lib/kubelet/pods/a6158cf0-bd94-4f82-b37a-1e395fe5db57/volumes"
Sep 16 15:04:07.488990 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:07.488977    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" path="/var/lib/kubelet/pods/f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f/volumes"
Sep 16 15:04:08.706433 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:08.706397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:12.922588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:12.922554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:13.015341 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:13.015305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:13.112235 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:13.112201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:15.921586 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:15.921554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:04:37.081302 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:37.081255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:04:40.846347 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:40.846308    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:04:57.326445 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:04:57.326404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:05:05.487726 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:05.487690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:05:05.492995 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:05.492968    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:05:07.527579 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.527545    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7676-64e876"]
Sep 16 15:05:07.527994 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.527975    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292612df-614b-4a35-98ff-1b6caf014114" containerName="maas-api"
Sep 16 15:05:07.527994 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.527988    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="292612df-614b-4a35-98ff-1b6caf014114" containerName="maas-api"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.527997    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf74e108-796e-43db-a8ce-bd5375786221" containerName="maas-api"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528002    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf74e108-796e-43db-a8ce-bd5375786221" containerName="maas-api"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528009    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" containerName="payload-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528015    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" containerName="payload-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" containerName="payload-pre-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528030    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" containerName="payload-pre-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528038    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="877d70c8-7004-4afb-b30c-b6e33258d1d5" containerName="maas-api"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528043    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="877d70c8-7004-4afb-b30c-b6e33258d1d5" containerName="maas-api"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528050    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528055    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528061    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" containerName="payload-pre-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528067    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" containerName="payload-pre-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528073    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528078    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a49d67c-48ab-47f7-95b1-c42bb39c1065" containerName="istio-proxy"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528086    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" containerName="payload-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528091    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" containerName="payload-processing"
Sep 16 15:05:07.528090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528102    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528109    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" containerName="payload-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528114    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" containerName="payload-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528125    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528129    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528202    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="292612df-614b-4a35-98ff-1b6caf014114" containerName="maas-api"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528210    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="be45875a-02a7-4f38-94b7-c6c9b205e4ff" containerName="payload-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528217    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528223    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee055c0-9cd9-42d4-a9b3-95dbb650c432" containerName="payload-pre-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528229    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528234    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecf5033-5908-45a1-9061-7cbd1ed647af" containerName="istio-proxy"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528239    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf74e108-796e-43db-a8ce-bd5375786221" containerName="maas-api"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528246    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6952f7b8-0e9d-4200-b48b-e8f9210145f3" containerName="payload-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528256    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0ab007c-b2cd-4efb-94f5-3ad6da3bbc6f" containerName="payload-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528261    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="877d70c8-7004-4afb-b30c-b6e33258d1d5" containerName="maas-api"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528266    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2ecc4c-eb8e-4e44-aec2-f4c980d07676" containerName="payload-pre-processing"
Sep 16 15:05:07.528652 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.528270    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:07.532727 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.532709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:07.535614 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.535587    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6cz7\""
Sep 16 15:05:07.537997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.537972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7676-64e876"]
Sep 16 15:05:07.590299 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.590262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ghlr\" (UniqueName: \"kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr\") pod \"test-curl-7676-64e876\" (UID: \"8cad98fc-f2aa-43cd-9453-2ce4a6be891f\") " pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:07.691585 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.691547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ghlr\" (UniqueName: \"kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr\") pod \"test-curl-7676-64e876\" (UID: \"8cad98fc-f2aa-43cd-9453-2ce4a6be891f\") " pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:07.700427 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.700394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ghlr\" (UniqueName: \"kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr\") pod \"test-curl-7676-64e876\" (UID: \"8cad98fc-f2aa-43cd-9453-2ce4a6be891f\") " pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:07.843332 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:07.843249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:08.114761 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:08.114735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7676-64e876"]
Sep 16 15:05:08.117491 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:05:08.117462    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cad98fc_f2aa_43cd_9453_2ce4a6be891f.slice/crio-6705c519c4cc5193f13e5457f9a3605645b740489de7362aa91a693efac70fac WatchSource:0}: Error finding container 6705c519c4cc5193f13e5457f9a3605645b740489de7362aa91a693efac70fac: Status 404 returned error can't find the container with id 6705c519c4cc5193f13e5457f9a3605645b740489de7362aa91a693efac70fac
Sep 16 15:05:08.918113 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:08.918076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7676-64e876" event={"ID":"8cad98fc-f2aa-43cd-9453-2ce4a6be891f","Type":"ContainerStarted","Data":"84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83"}
Sep 16 15:05:08.918113 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:08.918118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7676-64e876" event={"ID":"8cad98fc-f2aa-43cd-9453-2ce4a6be891f","Type":"ContainerStarted","Data":"6705c519c4cc5193f13e5457f9a3605645b740489de7362aa91a693efac70fac"}
Sep 16 15:05:08.934457 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:08.934344    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7676-64e876" podStartSLOduration=1.934327567 podStartE2EDuration="1.934327567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:05:08.933392671 +0000 UTC m=+1804.034868135" watchObservedRunningTime="2026-09-16 15:05:08.934327567 +0000 UTC m=+1804.035803141"
Sep 16 15:05:09.519760 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.519725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7676-64e876"]
Sep 16 15:05:09.524544 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.524514    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7676-64e876"]
Sep 16 15:05:09.634355 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634273    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7676-e760aa"]
Sep 16 15:05:09.634663 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634651    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:09.634707 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634664    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8e327c-808a-4750-8295-28e03fb17441" containerName="istio-proxy"
Sep 16 15:05:09.634707 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634677    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" containerName="test-curl-7676-64e876"
Sep 16 15:05:09.634707 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634682    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" containerName="test-curl-7676-64e876"
Sep 16 15:05:09.634812 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.634755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" containerName="test-curl-7676-64e876"
Sep 16 15:05:09.637790 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.637775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:09.645718 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.645692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7676-e760aa"]
Sep 16 15:05:09.712448 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.712410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68f8s\" (UniqueName: \"kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s\") pod \"test-curl-7676-e760aa\" (UID: \"dc7687eb-226b-4cb8-bc66-2c090e73099b\") " pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:09.813576 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.813543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68f8s\" (UniqueName: \"kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s\") pod \"test-curl-7676-e760aa\" (UID: \"dc7687eb-226b-4cb8-bc66-2c090e73099b\") " pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:09.822383 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.822357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68f8s\" (UniqueName: \"kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s\") pod \"test-curl-7676-e760aa\" (UID: \"dc7687eb-226b-4cb8-bc66-2c090e73099b\") " pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:09.923009 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:09.922904    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7676-64e876" container="test-curl-7676-64e876"
Sep 16 15:05:09.947899 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:09.947869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:10.218315 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:10.218234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7676-e760aa"]
Sep 16 15:05:10.221771 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:05:10.221746    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc7687eb_226b_4cb8_bc66_2c090e73099b.slice/crio-5b2a1996ff1975bd05c2be8a3f3f45e053e008f3fee10eb297e32963edb3bc11 WatchSource:0}: Error finding container 5b2a1996ff1975bd05c2be8a3f3f45e053e008f3fee10eb297e32963edb3bc11: Status 404 returned error can't find the container with id 5b2a1996ff1975bd05c2be8a3f3f45e053e008f3fee10eb297e32963edb3bc11
Sep 16 15:05:10.665760 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:10.665724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:05:10.929563 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:10.929471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7676-e760aa" event={"ID":"dc7687eb-226b-4cb8-bc66-2c090e73099b","Type":"ContainerStarted","Data":"da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23"}
Sep 16 15:05:10.929563 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:10.929515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7676-e760aa" event={"ID":"dc7687eb-226b-4cb8-bc66-2c090e73099b","Type":"ContainerStarted","Data":"5b2a1996ff1975bd05c2be8a3f3f45e053e008f3fee10eb297e32963edb3bc11"}
Sep 16 15:05:10.930082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:10.929625    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7676-64e876" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" containerName="test-curl-7676-64e876" containerID="cri-o://84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83" gracePeriod=2
Sep 16 15:05:10.962357 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:10.962315    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7676-64e876\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:11.555721 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:11.555667    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7676-e760aa" podStartSLOduration=2.5556511200000003 podStartE2EDuration="2.55565112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:05:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:05:10.957500424 +0000 UTC m=+1806.058975868" watchObservedRunningTime="2026-09-16 15:05:11.55565112 +0000 UTC m=+1806.657126573"
Sep 16 15:05:11.556165 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:11.556151    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7676-e760aa"]
Sep 16 15:05:11.560672 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:11.560647    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7676-e760aa"]
Sep 16 15:05:11.934774 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:11.934740    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7676-e760aa" container="test-curl-7676-e760aa"
Sep 16 15:05:12.939472 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:12.939439    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7676-e760aa" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" containerName="test-curl-7676-e760aa" containerID="cri-o://da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23" gracePeriod=2
Sep 16 15:05:12.942074 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:12.942041    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7676-e760aa\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:13.104203 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.104144    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:13.106602 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:13.106578    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7676-e760aa\" is forbidden: User \"system:node:ip-10-0-136-124.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-124.ec2.internal' and this object" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:13.246147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.246040    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ghlr\" (UniqueName: \"kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr\") pod \"8cad98fc-f2aa-43cd-9453-2ce4a6be891f\" (UID: \"8cad98fc-f2aa-43cd-9453-2ce4a6be891f\") "
Sep 16 15:05:13.248158 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.248124    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr" (OuterVolumeSpecName: "kube-api-access-8ghlr") pod "8cad98fc-f2aa-43cd-9453-2ce4a6be891f" (UID: "8cad98fc-f2aa-43cd-9453-2ce4a6be891f"). InnerVolumeSpecName "kube-api-access-8ghlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:05:13.347424 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.347384    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ghlr\" (UniqueName: \"kubernetes.io/projected/8cad98fc-f2aa-43cd-9453-2ce4a6be891f-kube-api-access-8ghlr\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:05:13.487867 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.487833    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" path="/var/lib/kubelet/pods/8cad98fc-f2aa-43cd-9453-2ce4a6be891f/volumes"
Sep 16 15:05:13.646095 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.646062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:05:13.945656 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.945566    2565 generic.go:356] "Generic (PLEG): container finished" podID="8cad98fc-f2aa-43cd-9453-2ce4a6be891f" containerID="84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83" exitCode=137
Sep 16 15:05:13.945656 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.945607    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-64e876"
Sep 16 15:05:13.946156 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.945667    2565 scope.go:117] "RemoveContainer" containerID="84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83"
Sep 16 15:05:13.954871 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.954849    2565 scope.go:117] "RemoveContainer" containerID="84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83"
Sep 16 15:05:13.955194 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:13.955173    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83\": container with ID starting with 84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83 not found: ID does not exist" containerID="84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83"
Sep 16 15:05:13.955287 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:13.955202    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83"} err="failed to get container status \"84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83\": rpc error: code = NotFound desc = could not find container \"84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83\": container with ID starting with 84958a13adb41c7069a36f9ae7770dcd32c60db63bfb60e85a46fb5f7f072f83 not found: ID does not exist"
Sep 16 15:05:14.625723 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:14.625688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:05:15.120100 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.120075    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:15.266908 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.266876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68f8s\" (UniqueName: \"kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s\") pod \"dc7687eb-226b-4cb8-bc66-2c090e73099b\" (UID: \"dc7687eb-226b-4cb8-bc66-2c090e73099b\") "
Sep 16 15:05:15.268909 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.268885    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s" (OuterVolumeSpecName: "kube-api-access-68f8s") pod "dc7687eb-226b-4cb8-bc66-2c090e73099b" (UID: "dc7687eb-226b-4cb8-bc66-2c090e73099b"). InnerVolumeSpecName "kube-api-access-68f8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:05:15.368069 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.368036    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68f8s\" (UniqueName: \"kubernetes.io/projected/dc7687eb-226b-4cb8-bc66-2c090e73099b-kube-api-access-68f8s\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:05:15.487691 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.487657    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" path="/var/lib/kubelet/pods/dc7687eb-226b-4cb8-bc66-2c090e73099b/volumes"
Sep 16 15:05:15.959049 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.959004    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc7687eb-226b-4cb8-bc66-2c090e73099b" containerID="da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23" exitCode=137
Sep 16 15:05:15.959252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.959054    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7676-e760aa"
Sep 16 15:05:15.959252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.959102    2565 scope.go:117] "RemoveContainer" containerID="da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23"
Sep 16 15:05:15.968120 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.968104    2565 scope.go:117] "RemoveContainer" containerID="da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23"
Sep 16 15:05:15.968371 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:05:15.968353    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23\": container with ID starting with da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23 not found: ID does not exist" containerID="da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23"
Sep 16 15:05:15.968421 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:15.968382    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23"} err="failed to get container status \"da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23\": rpc error: code = NotFound desc = could not find container \"da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23\": container with ID starting with da9f582ab4494c2b099b592f26bd5e311b20598b394dd05ab8d39415e30a2b23 not found: ID does not exist"
Sep 16 15:05:22.204130 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:22.204089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:05:32.546303 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:32.546262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:05:35.345743 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:35.345708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:05:52.917341 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:52.917302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:05:56.618902 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:05:56.618870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:06:05.718436 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:05.718404    2565 scope.go:117] "RemoveContainer" containerID="caa9e607386e96cd6a4f8ae5f30e163169d83e66305eab001e98999042413969"
Sep 16 15:06:22.612349 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:22.612313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:06:32.412345 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:32.412257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:06:38.913897 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:38.913858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:39.850625 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:39.850581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:40.311384 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.311355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:40.588078 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.587980    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:06:40.588399 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.588385    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" containerName="test-curl-7676-e760aa"
Sep 16 15:06:40.588450 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.588400    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" containerName="test-curl-7676-e760aa"
Sep 16 15:06:40.588488 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.588470    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7687eb-226b-4cb8-bc66-2c090e73099b" containerName="test-curl-7676-e760aa"
Sep 16 15:06:40.591547 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.591525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.595811 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.595792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-91f4ab-openshift-default-dockercfg-8gnfp\""
Sep 16 15:06:40.613194 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.613171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:06:40.641657 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.641615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:40.729156 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729370 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729370 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhwn\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729370 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.729537 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.729483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830097 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830305 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhwn\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.830925 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.830874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.831075 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.831026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.831075 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.831059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.832620 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.832598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.832950 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.832924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.839464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.839406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.839553 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.839507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhwn\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn\") pod \"e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") " pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.902813 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.902776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:40.958735 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:40.958392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:41.181783 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.181755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:06:41.184267 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:06:41.184237    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc5518b_d014_46f5_aecd_8caa57e6e896.slice/crio-3b591a2cd94058811097120294f1f92c36f9554d416279dee4cfca753df2bccd WatchSource:0}: Error finding container 3b591a2cd94058811097120294f1f92c36f9554d416279dee4cfca753df2bccd: Status 404 returned error can't find the container with id 3b591a2cd94058811097120294f1f92c36f9554d416279dee4cfca753df2bccd
Sep 16 15:06:41.186606 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.186566    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:06:41.186688 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.186651    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:06:41.186731 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.186692    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:06:41.393058 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.393012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerStarted","Data":"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"}
Sep 16 15:06:41.393484 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.393117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerStarted","Data":"3b591a2cd94058811097120294f1f92c36f9554d416279dee4cfca753df2bccd"}
Sep 16 15:06:41.417891 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.417831    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podStartSLOduration=1.41780837 podStartE2EDuration="1.41780837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:06:41.414691172 +0000 UTC m=+1896.516166626" watchObservedRunningTime="2026-09-16 15:06:41.41780837 +0000 UTC m=+1896.519283823"
Sep 16 15:06:41.903861 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:41.903822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:42.686182 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:42.686137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:42.908164 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:42.908133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:42.923632 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:42.923600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:06:43.372498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:43.372463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:43.403740 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:43.403706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:43.404754 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:43.404735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:06:43.577130 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:43.577097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:43.707749 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:43.707645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:44.394596 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:44.394565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:45.313890 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.313857    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:06:45.318344 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.318319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.321803 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.321761    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-91f4ab-serving-cert\""
Sep 16 15:06:45.321963 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.321803    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 15:06:45.321963 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.321837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2cp94\""
Sep 16 15:06:45.321963 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.321915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 15:06:45.322273 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.322259    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 15:06:45.330959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.330840    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:06:45.345245 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.345216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:45.372548 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.372518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.372702 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.372587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.372702 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.372610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.372797 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.372722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftndm\" (UniqueName: \"kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.444634 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.444600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:45.473716 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.473684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.473907 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.473729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.474094 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:06:45.473902    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-serving-cert: secret "maas-api-e2e-ipp-a-91f4ab-serving-cert" not found
Sep 16 15:06:45.474094 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:06:45.473996    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls podName:77939086-6bcc-4231-b65f-0ec7f9b12e87 nodeName:}" failed. No retries permitted until 2026-09-16 15:06:45.973974689 +0000 UTC m=+1901.075450124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls") pod "maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" (UID: "77939086-6bcc-4231-b65f-0ec7f9b12e87") : secret "maas-api-e2e-ipp-a-91f4ab-serving-cert" not found
Sep 16 15:06:45.474217 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.473907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftndm\" (UniqueName: \"kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.474217 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.474192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.474352 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.474331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.476579 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.476560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.485422 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.485400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftndm\" (UniqueName: \"kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.826892 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.826859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:45.929981 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.929934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:45.936885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.936859    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:06:45.940503 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.940488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:45.942920 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.942897    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-91f4ab\""
Sep 16 15:06:45.942920 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.942901    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-91f4ab-dockercfg-bzks6\""
Sep 16 15:06:45.951464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.951438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:06:45.980380 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.980352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:45.982681 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:45.982646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") pod \"maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:46.028321 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.028286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:06:46.081458 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.081379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.081611 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.081504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrc6\" (UniqueName: \"kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.182524 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.182490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.182681 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.182568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrc6\" (UniqueName: \"kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.183307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.183285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.190249 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.190231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrc6\" (UniqueName: \"kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6\") pod \"payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.232597 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.232562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:46.253723 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.253691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:46.517997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.517914    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:06:46.520570 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:06:46.520546    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77939086_6bcc_4231_b65f_0ec7f9b12e87.slice/crio-2ae5ff0474f164cd4168c6eaf3321e960265ede3b74d72b94f4f7f90bf05cfa7 WatchSource:0}: Error finding container 2ae5ff0474f164cd4168c6eaf3321e960265ede3b74d72b94f4f7f90bf05cfa7: Status 404 returned error can't find the container with id 2ae5ff0474f164cd4168c6eaf3321e960265ede3b74d72b94f4f7f90bf05cfa7
Sep 16 15:06:46.522379 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.522359    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:06:46.541892 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:46.541871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:06:46.543566 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:06:46.543545    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7168a87_ad9a_4fe2_8d31_d85e75b7fe6c.slice/crio-4c5a93c24a42341cd8e901b4fdb2c4bbea7ff21c46c384ae95d31469fa8b518b WatchSource:0}: Error finding container 4c5a93c24a42341cd8e901b4fdb2c4bbea7ff21c46c384ae95d31469fa8b518b: Status 404 returned error can't find the container with id 4c5a93c24a42341cd8e901b4fdb2c4bbea7ff21c46c384ae95d31469fa8b518b
Sep 16 15:06:47.425637 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.425593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" event={"ID":"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c","Type":"ContainerStarted","Data":"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"}
Sep 16 15:06:47.425808 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.425670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:47.425808 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.425697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" event={"ID":"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c","Type":"ContainerStarted","Data":"4c5a93c24a42341cd8e901b4fdb2c4bbea7ff21c46c384ae95d31469fa8b518b"}
Sep 16 15:06:47.427193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.427170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" event={"ID":"77939086-6bcc-4231-b65f-0ec7f9b12e87","Type":"ContainerStarted","Data":"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"}
Sep 16 15:06:47.427331 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.427207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" event={"ID":"77939086-6bcc-4231-b65f-0ec7f9b12e87","Type":"ContainerStarted","Data":"2ae5ff0474f164cd4168c6eaf3321e960265ede3b74d72b94f4f7f90bf05cfa7"}
Sep 16 15:06:47.427331 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.427244    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:47.444879 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.444832    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" podStartSLOduration=2.444818386 podStartE2EDuration="2.444818386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:06:47.443746009 +0000 UTC m=+1902.545221462" watchObservedRunningTime="2026-09-16 15:06:47.444818386 +0000 UTC m=+1902.546293839"
Sep 16 15:06:47.460661 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:47.460612    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" podStartSLOduration=2.080029299 podStartE2EDuration="2.460595533s" totalImagesPullingTime="380.566234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:06:47.459551786 +0000 UTC m=+1902.561027238" watchObservedRunningTime="2026-09-16 15:06:47.460595533 +0000 UTC m=+1902.562070985"
Sep 16 15:06:53.437720 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:53.437690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:06:55.424573 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:55.424531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:06:58.435063 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:58.435030    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:06:58.504558 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:58.504521    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": read tcp 10.132.0.2:36362->10.132.0.85:15021: read: connection reset by peer" start-of-body=
Sep 16 15:06:58.504703 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:58.504617    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": read tcp 10.132.0.2:36362->10.132.0.85:15021: read: connection reset by peer"
Sep 16 15:06:59.512821 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.512789    2565 generic.go:356] "Generic (PLEG): container finished" podID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerID="6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a" exitCode=0
Sep 16 15:06:59.513344 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.512853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerDied","Data":"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"}
Sep 16 15:06:59.513415 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.513361    2565 scope.go:117] "RemoveContainer" containerID="6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"
Sep 16 15:06:59.514498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.514470    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:06:59.514561 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.514536    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:06:59.514607 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:06:59.514565    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:07:00.520014 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:00.519979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerStarted","Data":"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"}
Sep 16 15:07:00.903725 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:00.903633    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:07:00.903906 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:00.903884    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 16 15:07:00.904005 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:00.903985    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 16 15:07:01.903379 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:01.903338    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 16 15:07:01.903773 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:01.903406    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 16 15:07:02.903564 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:02.903527    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 16 15:07:02.903990 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:02.903581    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 16 15:07:03.903429 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:03.903388    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 16 15:07:03.903618 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:03.903447    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 16 15:07:04.903319 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:04.903283    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 16 15:07:04.903508 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:04.903339    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 16 15:07:05.907307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:05.907278    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:07:05.907786 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:05.907596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:07:05.908539 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:05.908515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:07:07.340024 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:07.339981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:08.137613 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:08.137565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:08.402381 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:08.402291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:10.208715 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:10.208678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:10.307706 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:10.307673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:12.649385 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:12.649350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:12.860742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:12.860704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:12.953359 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:12.953240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:13.581808 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:13.581763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:14.457980 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:14.457933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:15.286850 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:15.286811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:15.384464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:15.384426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:15.799147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:15.799115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:15.903807 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:15.903771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:17.628212 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:17.628175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:20.209432 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:20.209396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:07:22.427463 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:22.427426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:22.530499 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:22.530461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:34.090995 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:34.090960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:38.473038 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:38.472999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:39.221351 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:39.221316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:39.960539 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:39.960502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:40.800228 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:40.800192    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:41.697631 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:41.697591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:43.015400 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:43.015366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:50.161375 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:50.161337    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:07:52.911443 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:07:52.911407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:08:07.717685 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:07.717606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:08:14.466036 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.465997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:14.758955 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.758904    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:08:14.762687 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.762663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.765443 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.765423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5fdb6e-openshift-default-dockercfg-fglh6\""
Sep 16 15:08:14.784405 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.784378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:08:14.796250 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.796205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:14.827294 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827451 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827320    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827451 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827451 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827451 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827688 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827688 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtm2p\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827688 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.827688 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.827528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928549 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtm2p\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.928744 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929115 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929115 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.928839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929115 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.929028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929289 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.929187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929289 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.929245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929389 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.929345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.929795 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.929770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.931277 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.931253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.931391 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.931370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.937508 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.937480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:14.937610 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:14.937570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtm2p\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p\") pod \"e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") " pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:15.073292 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.073213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:15.107686 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.107637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:15.354628 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.354603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:08:15.356891 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:08:15.356865    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220f6eaa_12a1_4627_8bc1_62a52b90a03a.slice/crio-72d5d208331169b87c11b254b1e4587671dfd273eefdc7ab953d0197861ee974 WatchSource:0}: Error finding container 72d5d208331169b87c11b254b1e4587671dfd273eefdc7ab953d0197861ee974: Status 404 returned error can't find the container with id 72d5d208331169b87c11b254b1e4587671dfd273eefdc7ab953d0197861ee974
Sep 16 15:08:15.359666 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.359630    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:15.359763 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.359709    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:15.359763 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.359750    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:15.908910 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.908871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerStarted","Data":"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"}
Sep 16 15:08:15.908910 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.908933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerStarted","Data":"72d5d208331169b87c11b254b1e4587671dfd273eefdc7ab953d0197861ee974"}
Sep 16 15:08:15.934463 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:15.934413    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podStartSLOduration=1.934399229 podStartE2EDuration="1.934399229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:08:15.932346304 +0000 UTC m=+1991.033821749" watchObservedRunningTime="2026-09-16 15:08:15.934399229 +0000 UTC m=+1991.035874681"
Sep 16 15:08:16.073995 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:16.073932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:16.080233 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:16.080206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:16.914509 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:16.914478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:16.915499 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:16.915479    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:17.171587 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:17.171505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:17.865313 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:17.865275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:18.000300 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:18.000261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:18.315258 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:18.315225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:19.531668 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:19.531635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:20.306949 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:20.306906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:21.157595 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:21.157563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:22.027915 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.027878    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:08:22.031813 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.031790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.035081 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.035060    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-5fdb6e-serving-cert\""
Sep 16 15:08:22.045109 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.045083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:08:22.074322 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.074291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:22.156146 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.156108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:22.200772 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.200742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.201147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.200789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rc5g\" (UniqueName: \"kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.201147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.200814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.201147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.200876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.302202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.302109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.302202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.302160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rc5g\" (UniqueName: \"kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.302202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.302185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.302486 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.302209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.302486 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:08:22.302341    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-serving-cert: secret "maas-api-e2e-ipp-cleanup-5fdb6e-serving-cert" not found
Sep 16 15:08:22.302486 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:08:22.302435    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls podName:9962ca0c-ba12-47db-91b2-af01e9db9dda nodeName:}" failed. No retries permitted until 2026-09-16 15:08:22.802412832 +0000 UTC m=+1997.903888264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" (UID: "9962ca0c-ba12-47db-91b2-af01e9db9dda") : secret "maas-api-e2e-ipp-cleanup-5fdb6e-serving-cert" not found
Sep 16 15:08:22.302902 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.302880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.304605 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.304587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.311165 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.311144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rc5g\" (UniqueName: \"kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.592103 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.592017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:22.695600 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.695568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:22.784158 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.784125    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:08:22.787888 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.787870    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:22.790845 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.790820    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-5fdb6e\""
Sep 16 15:08:22.792245 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.792225    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-5fdb6e-dockercfg-47swt\""
Sep 16 15:08:22.804068 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.804046    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:08:22.808404 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.808378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.811035 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.811015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:22.909612 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.909514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzq69\" (UniqueName: \"kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:22.909612 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.909571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:22.944666 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:22.944633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:23.011550 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.010656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzq69\" (UniqueName: \"kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.011550 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.010740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.011763 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.011656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.021327 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.021303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzq69\" (UniqueName: \"kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69\") pod \"payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.098592 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.098557    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.120993 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.120963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:23.218037 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.218012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:08:23.220663 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:08:23.220629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9962ca0c_ba12_47db_91b2_af01e9db9dda.slice/crio-8ca3e1e0c4003052b8afb3a57391a06aea917d10c5560d42b87779521f48e05f WatchSource:0}: Error finding container 8ca3e1e0c4003052b8afb3a57391a06aea917d10c5560d42b87779521f48e05f: Status 404 returned error can't find the container with id 8ca3e1e0c4003052b8afb3a57391a06aea917d10c5560d42b87779521f48e05f
Sep 16 15:08:23.376221 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.376043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:08:23.379124 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:08:23.379100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67daa05_ad86_4b4d_bc92_71abb558d564.slice/crio-f348385def25f88263a94adfcb82a8c5df285d66455d3dba384cd26ec60760fd WatchSource:0}: Error finding container f348385def25f88263a94adfcb82a8c5df285d66455d3dba384cd26ec60760fd: Status 404 returned error can't find the container with id f348385def25f88263a94adfcb82a8c5df285d66455d3dba384cd26ec60760fd
Sep 16 15:08:23.952858 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.952821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" event={"ID":"f67daa05-ad86-4b4d-bc92-71abb558d564","Type":"ContainerStarted","Data":"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"}
Sep 16 15:08:23.952974 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.952888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" event={"ID":"f67daa05-ad86-4b4d-bc92-71abb558d564","Type":"ContainerStarted","Data":"f348385def25f88263a94adfcb82a8c5df285d66455d3dba384cd26ec60760fd"}
Sep 16 15:08:23.953088 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.953068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:23.954713 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.954675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" event={"ID":"9962ca0c-ba12-47db-91b2-af01e9db9dda","Type":"ContainerStarted","Data":"9f887e3486d21c2ab4f8b8e1155b991999be34b55833846c8b721934456b8288"}
Sep 16 15:08:23.954838 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.954720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" event={"ID":"9962ca0c-ba12-47db-91b2-af01e9db9dda","Type":"ContainerStarted","Data":"8ca3e1e0c4003052b8afb3a57391a06aea917d10c5560d42b87779521f48e05f"}
Sep 16 15:08:23.954838 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.954755    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:23.972157 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.972104    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" podStartSLOduration=1.9720873509999999 podStartE2EDuration="1.972087351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:08:23.971326589 +0000 UTC m=+1999.072802042" watchObservedRunningTime="2026-09-16 15:08:23.972087351 +0000 UTC m=+1999.073562804"
Sep 16 15:08:23.990375 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:23.990337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" podStartSLOduration=1.3257213860000001 podStartE2EDuration="1.990323151s" totalImagesPullingTime="664.601765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:08:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:08:23.988661362 +0000 UTC m=+1999.090136827" watchObservedRunningTime="2026-09-16 15:08:23.990323151 +0000 UTC m=+1999.091798603"
Sep 16 15:08:27.442975 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:27.442924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:08:29.976345 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:29.976305    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:08:34.964163 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:34.964119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:08:38.035773 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.035742    2565 generic.go:356] "Generic (PLEG): container finished" podID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerID="953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d" exitCode=0
Sep 16 15:08:38.036324 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.035817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerDied","Data":"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"}
Sep 16 15:08:38.036324 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.036256    2565 scope.go:117] "RemoveContainer" containerID="953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"
Sep 16 15:08:38.037315 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.037286    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:38.037412 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.037355    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:38.037412 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:38.037404    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 16 15:08:39.042896 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:39.042863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerStarted","Data":"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"}
Sep 16 15:08:39.073501 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:39.073466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:39.073694 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:39.073630    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:39.073779 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:39.073692    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:40.073989 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:40.073931    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:40.074620 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:40.074586    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:41.073810 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:41.073773    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:41.074129 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:41.074100    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:42.074006 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:42.073970    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:42.074290 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:42.074263    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:43.074343 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:43.074302    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:43.074869 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:43.074367    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:44.073636 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:44.073588    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Sep 16 15:08:44.073856 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:44.073661    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Sep 16 15:08:44.246499 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:44.246462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:44.988068 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:44.988030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:45.078428 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:45.078401    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:45.078694 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:45.078672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:45.079331 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:45.079317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:08:45.739289 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:45.739253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:46.664291 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:46.664256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:47.605277 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:47.605238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:47.895607 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:47.895524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:48.467358 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:48.467326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:49.700129 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:49.700093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:50.444365 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:50.444335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:51.500266 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:51.500235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:51.606000 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:51.605967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:52.360468 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:52.360422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:52.458627 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:52.458591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:53.463364 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:53.463326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:54.454177 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:54.454144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:08:59.906024 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:59.905991    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:08:59.906471 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:59.906224    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerName="maas-api" containerID="cri-o://9f887e3486d21c2ab4f8b8e1155b991999be34b55833846c8b721934456b8288" gracePeriod=30
Sep 16 15:08:59.961784 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:59.961745    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.89:8443/health\": dial tcp 10.132.0.89:8443: connect: connection refused"
Sep 16 15:08:59.994715 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:08:59.994678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:00.080099 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.080068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:09:00.081129 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.080528    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" podUID="f67daa05-ad86-4b4d-bc92-71abb558d564" containerName="payload-pre-processing" containerID="cri-o://600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15" gracePeriod=30
Sep 16 15:09:00.129072 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.129029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:00.169020 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.168992    2565 generic.go:356] "Generic (PLEG): container finished" podID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerID="9f887e3486d21c2ab4f8b8e1155b991999be34b55833846c8b721934456b8288" exitCode=0
Sep 16 15:09:00.169170 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.169070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" event={"ID":"9962ca0c-ba12-47db-91b2-af01e9db9dda","Type":"ContainerDied","Data":"9f887e3486d21c2ab4f8b8e1155b991999be34b55833846c8b721934456b8288"}
Sep 16 15:09:00.208760 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.208729    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:09:00.325737 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.325713    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:09:00.359346 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.359267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:00.372047 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.372019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca\") pod \"9962ca0c-ba12-47db-91b2-af01e9db9dda\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") "
Sep 16 15:09:00.372242 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.372058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs\") pod \"9962ca0c-ba12-47db-91b2-af01e9db9dda\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") "
Sep 16 15:09:00.372242 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.372125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rc5g\" (UniqueName: \"kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g\") pod \"9962ca0c-ba12-47db-91b2-af01e9db9dda\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") "
Sep 16 15:09:00.372242 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.372202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") pod \"9962ca0c-ba12-47db-91b2-af01e9db9dda\" (UID: \"9962ca0c-ba12-47db-91b2-af01e9db9dda\") "
Sep 16 15:09:00.372478 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.372448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9962ca0c-ba12-47db-91b2-af01e9db9dda" (UID: "9962ca0c-ba12-47db-91b2-af01e9db9dda"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:09:00.374982 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.374924    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9962ca0c-ba12-47db-91b2-af01e9db9dda" (UID: "9962ca0c-ba12-47db-91b2-af01e9db9dda"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:09:00.375116 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.375096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9962ca0c-ba12-47db-91b2-af01e9db9dda" (UID: "9962ca0c-ba12-47db-91b2-af01e9db9dda"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:09:00.377463 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.377437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g" (OuterVolumeSpecName: "kube-api-access-8rc5g") pod "9962ca0c-ba12-47db-91b2-af01e9db9dda" (UID: "9962ca0c-ba12-47db-91b2-af01e9db9dda"). InnerVolumeSpecName "kube-api-access-8rc5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:00.473684 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473594    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzq69\" (UniqueName: \"kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69\") pod \"f67daa05-ad86-4b4d-bc92-71abb558d564\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") "
Sep 16 15:09:00.473684 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473679    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume\") pod \"f67daa05-ad86-4b4d-bc92-71abb558d564\" (UID: \"f67daa05-ad86-4b4d-bc92-71abb558d564\") "
Sep 16 15:09:00.473885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473858    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.473885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473868    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9962ca0c-ba12-47db-91b2-af01e9db9dda-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.473885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473878    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9962ca0c-ba12-47db-91b2-af01e9db9dda-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.473885 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.473885    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rc5g\" (UniqueName: \"kubernetes.io/projected/9962ca0c-ba12-47db-91b2-af01e9db9dda-kube-api-access-8rc5g\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.474095 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.474058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f67daa05-ad86-4b4d-bc92-71abb558d564" (UID: "f67daa05-ad86-4b4d-bc92-71abb558d564"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:09:00.475645 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.475625    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69" (OuterVolumeSpecName: "kube-api-access-bzq69") pod "f67daa05-ad86-4b4d-bc92-71abb558d564" (UID: "f67daa05-ad86-4b4d-bc92-71abb558d564"). InnerVolumeSpecName "kube-api-access-bzq69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:00.486154 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.486123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:00.575474 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.575437    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzq69\" (UniqueName: \"kubernetes.io/projected/f67daa05-ad86-4b4d-bc92-71abb558d564-kube-api-access-bzq69\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.575474 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.575468    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f67daa05-ad86-4b4d-bc92-71abb558d564-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:00.839243 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.839200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:00.959279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:00.959246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:01.176010 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.175898    2565 generic.go:356] "Generic (PLEG): container finished" podID="f67daa05-ad86-4b4d-bc92-71abb558d564" containerID="600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15" exitCode=0
Sep 16 15:09:01.176010 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.175978    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"
Sep 16 15:09:01.176010 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.175984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" event={"ID":"f67daa05-ad86-4b4d-bc92-71abb558d564","Type":"ContainerDied","Data":"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"}
Sep 16 15:09:01.176275 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.176034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x" event={"ID":"f67daa05-ad86-4b4d-bc92-71abb558d564","Type":"ContainerDied","Data":"f348385def25f88263a94adfcb82a8c5df285d66455d3dba384cd26ec60760fd"}
Sep 16 15:09:01.176275 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.176058    2565 scope.go:117] "RemoveContainer" containerID="600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"
Sep 16 15:09:01.177501 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.177429    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"
Sep 16 15:09:01.177559 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.177425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc" event={"ID":"9962ca0c-ba12-47db-91b2-af01e9db9dda","Type":"ContainerDied","Data":"8ca3e1e0c4003052b8afb3a57391a06aea917d10c5560d42b87779521f48e05f"}
Sep 16 15:09:01.186341 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.186325    2565 scope.go:117] "RemoveContainer" containerID="600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"
Sep 16 15:09:01.186640 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:09:01.186613    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15\": container with ID starting with 600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15 not found: ID does not exist" containerID="600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"
Sep 16 15:09:01.186733 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.186650    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15"} err="failed to get container status \"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15\": rpc error: code = NotFound desc = could not find container \"600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15\": container with ID starting with 600463881e15876935eaa2dc3570d2196b83e80739fba7f16128974c11ea4c15 not found: ID does not exist"
Sep 16 15:09:01.186733 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.186675    2565 scope.go:117] "RemoveContainer" containerID="9f887e3486d21c2ab4f8b8e1155b991999be34b55833846c8b721934456b8288"
Sep 16 15:09:01.204426 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.204401    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:09:01.207710 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.207691    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-5fdb6e-6ccc5ffbf5-289zc"]
Sep 16 15:09:01.219713 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.219690    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:09:01.222872 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.222852    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x"]
Sep 16 15:09:01.487541 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.487461    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" path="/var/lib/kubelet/pods/9962ca0c-ba12-47db-91b2-af01e9db9dda/volumes"
Sep 16 15:09:01.487842 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.487829    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67daa05-ad86-4b4d-bc92-71abb558d564" path="/var/lib/kubelet/pods/f67daa05-ad86-4b4d-bc92-71abb558d564/volumes"
Sep 16 15:09:01.785651 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:01.785614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:02.688047 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:02.688007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:02.835252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:02.835208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:03.978953 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:03.978900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:04.402412 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:04.402378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:09:05.159006 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:05.158971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:07.660592 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:07.660547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:07.763788 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:07.763750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:07.890217 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:07.890183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:09:07.890453 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:07.890426    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy" containerID="cri-o://55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc" gracePeriod=30
Sep 16 15:09:07.916703 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:07.916639    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:11.127479 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:11.127440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:12.096656 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:12.096618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:12.935273 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:12.935235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:13.151285 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.151219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:09:13.197787 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.197744    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.197997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.197800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtm2p\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.197997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.197848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.197997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.197870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198050    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198082    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198093    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198116    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert\") pod \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\" (UID: \"220f6eaa-12a1-4627-8bc1-62a52b90a03a\") "
Sep 16 15:09:13.198507 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198227    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:13.198596 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198578    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.198659 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.198602    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.199776 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.199320    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data" (OuterVolumeSpecName: "istio-data") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:13.199776 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.199511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:09:13.199776 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.199723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:13.205382 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.200601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token" (OuterVolumeSpecName: "istio-token") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:13.208764 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.208734    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:09:13.208896 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.208754    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p" (OuterVolumeSpecName: "kube-api-access-dtm2p") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "kube-api-access-dtm2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:13.208896 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.208862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "220f6eaa-12a1-4627-8bc1-62a52b90a03a" (UID: "220f6eaa-12a1-4627-8bc1-62a52b90a03a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:09:13.242680 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.242647    2565 generic.go:356] "Generic (PLEG): container finished" podID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerID="55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc" exitCode=0
Sep 16 15:09:13.242821 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.242703    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"
Sep 16 15:09:13.242821 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.242734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerDied","Data":"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"}
Sep 16 15:09:13.243065 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.242819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz" event={"ID":"220f6eaa-12a1-4627-8bc1-62a52b90a03a","Type":"ContainerDied","Data":"72d5d208331169b87c11b254b1e4587671dfd273eefdc7ab953d0197861ee974"}
Sep 16 15:09:13.243065 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.242843    2565 scope.go:117] "RemoveContainer" containerID="55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"
Sep 16 15:09:13.251700 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.251682    2565 scope.go:117] "RemoveContainer" containerID="953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"
Sep 16 15:09:13.260292 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.260272    2565 scope.go:117] "RemoveContainer" containerID="55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"
Sep 16 15:09:13.260566 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:09:13.260546    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc\": container with ID starting with 55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc not found: ID does not exist" containerID="55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"
Sep 16 15:09:13.260667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.260572    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc"} err="failed to get container status \"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc\": rpc error: code = NotFound desc = could not find container \"55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc\": container with ID starting with 55fbd06b33410e757dae1e5e841c10fa98604b6fce75c9deb786c58e4bc6ecfc not found: ID does not exist"
Sep 16 15:09:13.260667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.260590    2565 scope.go:117] "RemoveContainer" containerID="953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"
Sep 16 15:09:13.260835 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:09:13.260815    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d\": container with ID starting with 953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d not found: ID does not exist" containerID="953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"
Sep 16 15:09:13.260890 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.260844    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d"} err="failed to get container status \"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d\": rpc error: code = NotFound desc = could not find container \"953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d\": container with ID starting with 953a3d5c5ad7fcaed70403ca423db0bae6fa7c7af9672409c3d0ed03d76a182d not found: ID does not exist"
Sep 16 15:09:13.269354 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.269327    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:09:13.271583 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.271561    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz"]
Sep 16 15:09:13.299794 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299767    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtm2p\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-kube-api-access-dtm2p\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299798    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299812    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299820    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299827    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220f6eaa-12a1-4627-8bc1-62a52b90a03a-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299834    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.299889 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.299841    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220f6eaa-12a1-4627-8bc1-62a52b90a03a-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:13.488166 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.488085    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" path="/var/lib/kubelet/pods/220f6eaa-12a1-4627-8bc1-62a52b90a03a/volumes"
Sep 16 15:09:13.744022 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:13.743930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:14.677332 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:14.677301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:15.473742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:15.473670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:16.473346 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:16.473313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:24.925086 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:24.925050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:09:27.288254 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.288224    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:09:27.288619 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.288424    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" podUID="77939086-6bcc-4231-b65f-0ec7f9b12e87" containerName="maas-api" containerID="cri-o://e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a" gracePeriod=30
Sep 16 15:09:27.351806 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.351754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:27.435628 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.435593    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:09:27.435890 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.435858    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" podUID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" containerName="payload-pre-processing" containerID="cri-o://c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f" gracePeriod=30
Sep 16 15:09:27.508722 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.508684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:27.566026 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.565998    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:09:27.634224 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.634186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs\") pod \"77939086-6bcc-4231-b65f-0ec7f9b12e87\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") "
Sep 16 15:09:27.634416 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.634234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca\") pod \"77939086-6bcc-4231-b65f-0ec7f9b12e87\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") "
Sep 16 15:09:27.634416 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.634266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftndm\" (UniqueName: \"kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm\") pod \"77939086-6bcc-4231-b65f-0ec7f9b12e87\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") "
Sep 16 15:09:27.634416 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.634327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") pod \"77939086-6bcc-4231-b65f-0ec7f9b12e87\" (UID: \"77939086-6bcc-4231-b65f-0ec7f9b12e87\") "
Sep 16 15:09:27.635261 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.635100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77939086-6bcc-4231-b65f-0ec7f9b12e87" (UID: "77939086-6bcc-4231-b65f-0ec7f9b12e87"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:09:27.636029 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.635926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:27.637323 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.637303    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77939086-6bcc-4231-b65f-0ec7f9b12e87" (UID: "77939086-6bcc-4231-b65f-0ec7f9b12e87"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:09:27.638125 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.638098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "77939086-6bcc-4231-b65f-0ec7f9b12e87" (UID: "77939086-6bcc-4231-b65f-0ec7f9b12e87"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:09:27.638231 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.638214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm" (OuterVolumeSpecName: "kube-api-access-ftndm") pod "77939086-6bcc-4231-b65f-0ec7f9b12e87" (UID: "77939086-6bcc-4231-b65f-0ec7f9b12e87"). InnerVolumeSpecName "kube-api-access-ftndm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:27.681423 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.681399    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:09:27.735799 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.735760    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncrc6\" (UniqueName: \"kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6\") pod \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") "
Sep 16 15:09:27.736014 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.735817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume\") pod \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\" (UID: \"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c\") "
Sep 16 15:09:27.736188 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.736166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" (UID: "a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:09:27.736270 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.736205    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftndm\" (UniqueName: \"kubernetes.io/projected/77939086-6bcc-4231-b65f-0ec7f9b12e87-kube-api-access-ftndm\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.736270 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.736218    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.736270 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.736227    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77939086-6bcc-4231-b65f-0ec7f9b12e87-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.736270 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.736235    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77939086-6bcc-4231-b65f-0ec7f9b12e87-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.738153 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.738109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6" (OuterVolumeSpecName: "kube-api-access-ncrc6") pod "a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" (UID: "a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c"). InnerVolumeSpecName "kube-api-access-ncrc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:09:27.775467 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.775434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:27.837575 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.837489    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncrc6\" (UniqueName: \"kubernetes.io/projected/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-kube-api-access-ncrc6\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.837575 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.837515    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:09:27.935963 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:27.935844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:28.280389 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.280348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:28.320912 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.320880    2565 generic.go:356] "Generic (PLEG): container finished" podID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" containerID="c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f" exitCode=0
Sep 16 15:09:28.321318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.320964    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"
Sep 16 15:09:28.321318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.320967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" event={"ID":"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c","Type":"ContainerDied","Data":"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"}
Sep 16 15:09:28.321318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.321030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4" event={"ID":"a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c","Type":"ContainerDied","Data":"4c5a93c24a42341cd8e901b4fdb2c4bbea7ff21c46c384ae95d31469fa8b518b"}
Sep 16 15:09:28.321318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.321054    2565 scope.go:117] "RemoveContainer" containerID="c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"
Sep 16 15:09:28.322432 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.322410    2565 generic.go:356] "Generic (PLEG): container finished" podID="77939086-6bcc-4231-b65f-0ec7f9b12e87" containerID="e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a" exitCode=0
Sep 16 15:09:28.322560 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.322507    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"
Sep 16 15:09:28.322560 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.322514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" event={"ID":"77939086-6bcc-4231-b65f-0ec7f9b12e87","Type":"ContainerDied","Data":"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"}
Sep 16 15:09:28.322646 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.322561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n" event={"ID":"77939086-6bcc-4231-b65f-0ec7f9b12e87","Type":"ContainerDied","Data":"2ae5ff0474f164cd4168c6eaf3321e960265ede3b74d72b94f4f7f90bf05cfa7"}
Sep 16 15:09:28.330315 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.330288    2565 scope.go:117] "RemoveContainer" containerID="c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"
Sep 16 15:09:28.330582 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:09:28.330549    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f\": container with ID starting with c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f not found: ID does not exist" containerID="c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"
Sep 16 15:09:28.330643 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.330594    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f"} err="failed to get container status \"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f\": rpc error: code = NotFound desc = could not find container \"c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f\": container with ID starting with c624ad03a3f29af6b1d6e15d7ee246e057e90498240a5bc7547fafa7b6153c0f not found: ID does not exist"
Sep 16 15:09:28.330643 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.330620    2565 scope.go:117] "RemoveContainer" containerID="e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"
Sep 16 15:09:28.338737 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.338721    2565 scope.go:117] "RemoveContainer" containerID="e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"
Sep 16 15:09:28.339026 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:09:28.339009    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a\": container with ID starting with e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a not found: ID does not exist" containerID="e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"
Sep 16 15:09:28.339081 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.339034    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a"} err="failed to get container status \"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a\": rpc error: code = NotFound desc = could not find container \"e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a\": container with ID starting with e61403b6a3735dc8d53cb905e516527675e8e17d4ba448cc741c13f179fee32a not found: ID does not exist"
Sep 16 15:09:28.354665 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.354642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:09:28.359998 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.359977    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-91f4ab-55cfd9c5c-2tc5n"]
Sep 16 15:09:28.383540 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.383508    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:09:28.389347 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.389320    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4"]
Sep 16 15:09:28.531995 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:28.531889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:29.487864 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:29.487827    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77939086-6bcc-4231-b65f-0ec7f9b12e87" path="/var/lib/kubelet/pods/77939086-6bcc-4231-b65f-0ec7f9b12e87/volumes"
Sep 16 15:09:29.488263 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:29.488238    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" path="/var/lib/kubelet/pods/a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c/volumes"
Sep 16 15:09:29.705082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:29.705043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:30.830215 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:30.830184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:31.897689 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:31.897650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:33.395061 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:33.395028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:09:38.573061 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:09:38.573025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:10:05.518598 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:05.518567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:10:05.525394 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:05.525369    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:10:11.204408 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:11.204366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:11.352797 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:11.352760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:17.484158 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:17.484105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:17.569298 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:17.569259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:17.754351 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:17.754317    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:10:17.754588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:17.754564    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" containerID="cri-o://82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3" gracePeriod=30
Sep 16 15:10:17.785725 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:17.785671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:18.308437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:18.308400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:19.375404 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:19.375363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:20.257251 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:20.257223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:20.910180 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:20.910146    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 15:10:20.910571 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:20.910211    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 15:10:21.038347 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:21.038303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:22.043623 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:22.043586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:23.001465 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.001441    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:10:23.163232 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163232 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163179    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163232 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163358    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmhwn\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo\") pod \"1fc5518b-d014-46f5-aecd-8caa57e6e896\" (UID: \"1fc5518b-d014-46f5-aecd-8caa57e6e896\") "
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:23.163802 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:10:23.164409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163850    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.164409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163870    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.164409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163885    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.164409 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.163898    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.165439 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.165414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:23.165439 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.165420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:10:23.165639 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.165623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn" (OuterVolumeSpecName: "kube-api-access-cmhwn") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "kube-api-access-cmhwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:23.165705 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.165693    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fc5518b-d014-46f5-aecd-8caa57e6e896" (UID: "1fc5518b-d014-46f5-aecd-8caa57e6e896"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:10:23.265142 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.265101    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc5518b-d014-46f5-aecd-8caa57e6e896-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.265142 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.265134    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.265142 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.265147    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmhwn\" (UniqueName: \"kubernetes.io/projected/1fc5518b-d014-46f5-aecd-8caa57e6e896-kube-api-access-cmhwn\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.265395 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.265161    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.265395 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.265172    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc5518b-d014-46f5-aecd-8caa57e6e896-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:23.590569 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.590532    2565 generic.go:356] "Generic (PLEG): container finished" podID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerID="82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3" exitCode=0
Sep 16 15:10:23.590741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.590578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerDied","Data":"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"}
Sep 16 15:10:23.590741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.590592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"
Sep 16 15:10:23.590741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.590633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg" event={"ID":"1fc5518b-d014-46f5-aecd-8caa57e6e896","Type":"ContainerDied","Data":"3b591a2cd94058811097120294f1f92c36f9554d416279dee4cfca753df2bccd"}
Sep 16 15:10:23.590741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.590656    2565 scope.go:117] "RemoveContainer" containerID="82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"
Sep 16 15:10:23.599993 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.599974    2565 scope.go:117] "RemoveContainer" containerID="6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"
Sep 16 15:10:23.607997 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.607980    2565 scope.go:117] "RemoveContainer" containerID="82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"
Sep 16 15:10:23.608290 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:10:23.608271    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3\": container with ID starting with 82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3 not found: ID does not exist" containerID="82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"
Sep 16 15:10:23.608356 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.608298    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3"} err="failed to get container status \"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3\": rpc error: code = NotFound desc = could not find container \"82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3\": container with ID starting with 82a8a2d9aa99065041acaabc634dfb4b4fdc2232a9f986515c019343548fd3b3 not found: ID does not exist"
Sep 16 15:10:23.608356 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.608316    2565 scope.go:117] "RemoveContainer" containerID="6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"
Sep 16 15:10:23.608582 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:10:23.608564    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a\": container with ID starting with 6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a not found: ID does not exist" containerID="6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"
Sep 16 15:10:23.608626 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.608589    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a"} err="failed to get container status \"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a\": rpc error: code = NotFound desc = could not find container \"6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a\": container with ID starting with 6ef5d315f981b8f5e8eff08f2e4c91c9385bd199fd6faa143e5c19814979445a not found: ID does not exist"
Sep 16 15:10:23.616106 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.616084    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:10:23.623124 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:23.623104    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg"]
Sep 16 15:10:25.487497 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:25.487463    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" path="/var/lib/kubelet/pods/1fc5518b-d014-46f5-aecd-8caa57e6e896/volumes"
Sep 16 15:10:28.767980 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:28.767926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:29.174034 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:29.173917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:29.276021 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:29.275981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:29.451343 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:29.451190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:29.555026 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:29.554993    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:30.816560 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:30.816521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:31.536149 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:31.536113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:31.918358 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:31.918283    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:10:36.759082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:36.759042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:36.853355 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:36.853313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:37.132504 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:37.132411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:37.769307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:37.769269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:39.180015 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:39.179978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:39.999002 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:39.998970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:40.833637 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:40.833600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.041193 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.041153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.088828 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.088797    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 15:10:48.089099 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.089072    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerName="payload-processing" containerID="cri-o://e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f" gracePeriod=30
Sep 16 15:10:48.142205 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.142165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.243367 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.243320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.328361 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.328330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.337162 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.337141    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 15:10:48.384760 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.384726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume\") pod \"c2446519-913d-4501-bc22-df43ceb3bf5a\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") "
Sep 16 15:10:48.384916 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.384846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrq25\" (UniqueName: \"kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25\") pod \"c2446519-913d-4501-bc22-df43ceb3bf5a\" (UID: \"c2446519-913d-4501-bc22-df43ceb3bf5a\") "
Sep 16 15:10:48.385137 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.385114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2446519-913d-4501-bc22-df43ceb3bf5a" (UID: "c2446519-913d-4501-bc22-df43ceb3bf5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:10:48.387065 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.387040    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25" (OuterVolumeSpecName: "kube-api-access-vrq25") pod "c2446519-913d-4501-bc22-df43ceb3bf5a" (UID: "c2446519-913d-4501-bc22-df43ceb3bf5a"). InnerVolumeSpecName "kube-api-access-vrq25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:10:48.445903 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.445865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.486159 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.486119    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2446519-913d-4501-bc22-df43ceb3bf5a-plugins-config-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:48.486159 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.486158    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrq25\" (UniqueName: \"kubernetes.io/projected/c2446519-913d-4501-bc22-df43ceb3bf5a-kube-api-access-vrq25\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:10:48.717108 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.717027    2565 generic.go:356] "Generic (PLEG): container finished" podID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerID="e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f" exitCode=0
Sep 16 15:10:48.717108 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.717072    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"
Sep 16 15:10:48.717108 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.717096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" event={"ID":"c2446519-913d-4501-bc22-df43ceb3bf5a","Type":"ContainerDied","Data":"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"}
Sep 16 15:10:48.717339 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.717145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" event={"ID":"c2446519-913d-4501-bc22-df43ceb3bf5a","Type":"ContainerDied","Data":"8a1461ae8f7a31bc5f7a8b08942ecc024d582bece996357a2f7860edbff4922a"}
Sep 16 15:10:48.717339 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.717175    2565 scope.go:117] "RemoveContainer" containerID="e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"
Sep 16 15:10:48.726393 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.726376    2565 scope.go:117] "RemoveContainer" containerID="e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"
Sep 16 15:10:48.726652 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:10:48.726632    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f\": container with ID starting with e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f not found: ID does not exist" containerID="e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"
Sep 16 15:10:48.726694 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.726660    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f"} err="failed to get container status \"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f\": rpc error: code = NotFound desc = could not find container \"e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f\": container with ID starting with e9212ff6cd85b3c4f0b47e58dffb991b1d02413faffed9dbfa814cc0ccc8b23f not found: ID does not exist"
Sep 16 15:10:48.742044 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.742016    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 15:10:48.742166 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.742065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:48.746747 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.746723    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f"]
Sep 16 15:10:48.843850 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:48.843823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:49.307150 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:49.307097    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.79:9004: i/o timeout"
Sep 16 15:10:49.487230 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:49.487197    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" path="/var/lib/kubelet/pods/c2446519-913d-4501-bc22-df43ceb3bf5a/volumes"
Sep 16 15:10:49.684244 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:49.684151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:51.115202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:51.115160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:10:55.088463 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:55.088422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:56.662831 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:56.662792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:56.952104 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:56.952010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:10:57.834247 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:10:57.834218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:06.269790 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:06.269741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:06.360493 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:06.360454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:06.492354 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:06.492316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:06.560232 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:06.560155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:06.950323 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:06.950240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:07.140357 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:07.140329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:08.917260 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:08.917220    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:11:13.139539 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:13.139505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:13.239662 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:13.239618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:13.341966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:13.341901    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 15:11:13.342228 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:13.342198    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" containerID="cri-o://b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd" gracePeriod=30
Sep 16 15:11:13.366202 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:13.366173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:15.529767 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:15.529728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:11:16.711691 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:16.711658    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 15:11:16.712084 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:16.711720    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 15:11:17.318200 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:17.318166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:11:18.596220 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.596194    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 15:11:18.762207 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762400 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762218    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nglnf\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762400 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762529 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762529 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762529 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762692 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762539    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762692 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762692 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data\") pod \"f832460b-5e61-4dbf-ada5-4170a55671ca\" (UID: \"f832460b-5e61-4dbf-ada5-4170a55671ca\") "
Sep 16 15:11:18.762850 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762685    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:18.762911 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762887    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:18.762994 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.762899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:11:18.763060 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.763040    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f832460b-5e61-4dbf-ada5-4170a55671ca-istiod-ca-cert\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.763112 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.763060    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.763112 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.763074    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-credential-socket\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.763112 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.763100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:18.763271 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.763151    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:18.764633 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.764603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 15:11:18.764762 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.764717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:11:18.764837 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.764821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf" (OuterVolumeSpecName: "kube-api-access-nglnf") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "kube-api-access-nglnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:11:18.765123 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.765097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "f832460b-5e61-4dbf-ada5-4170a55671ca" (UID: "f832460b-5e61-4dbf-ada5-4170a55671ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:11:18.864224 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864201    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-workload-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.864224 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864222    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-envoy\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.864224 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864230    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-data\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.864424 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864237    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-token\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.864424 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864245    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nglnf\" (UniqueName: \"kubernetes.io/projected/f832460b-5e61-4dbf-ada5-4170a55671ca-kube-api-access-nglnf\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.864424 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.864253    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f832460b-5e61-4dbf-ada5-4170a55671ca-istio-podinfo\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:11:18.869200 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.869174    2565 generic.go:356] "Generic (PLEG): container finished" podID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerID="b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd" exitCode=0
Sep 16 15:11:18.869301 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.869217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"
Sep 16 15:11:18.869301 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.869252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerDied","Data":"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"}
Sep 16 15:11:18.869301 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.869296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng" event={"ID":"f832460b-5e61-4dbf-ada5-4170a55671ca","Type":"ContainerDied","Data":"ae479707114b0bc6bc3a86037f26456b019ca52edfdf0fe448ce37f7cdcbf8ff"}
Sep 16 15:11:18.869469 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.869322    2565 scope.go:117] "RemoveContainer" containerID="b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"
Sep 16 15:11:18.884872 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.884849    2565 scope.go:117] "RemoveContainer" containerID="275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"
Sep 16 15:11:18.892976 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.892958    2565 scope.go:117] "RemoveContainer" containerID="b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"
Sep 16 15:11:18.893209 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:11:18.893192    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd\": container with ID starting with b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd not found: ID does not exist" containerID="b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"
Sep 16 15:11:18.893252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.893218    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd"} err="failed to get container status \"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd\": rpc error: code = NotFound desc = could not find container \"b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd\": container with ID starting with b33f43ad957c855e482a7c67c3a3c159c8ed6cb3eb36e3f4753516ebaa644acd not found: ID does not exist"
Sep 16 15:11:18.893252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.893234    2565 scope.go:117] "RemoveContainer" containerID="275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"
Sep 16 15:11:18.893457 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:11:18.893441    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202\": container with ID starting with 275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202 not found: ID does not exist" containerID="275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"
Sep 16 15:11:18.893494 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.893461    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202"} err="failed to get container status \"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202\": rpc error: code = NotFound desc = could not find container \"275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202\": container with ID starting with 275ff01ab0344fd9b5b8a99f189ebf23688f8d8dc2677d8e4f3381ba0d519202 not found: ID does not exist"
Sep 16 15:11:18.896960 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.896926    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 15:11:18.901292 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:18.901274    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng"]
Sep 16 15:11:19.487759 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:11:19.487722    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" path="/var/lib/kubelet/pods/f832460b-5e61-4dbf-ada5-4170a55671ca/volumes"
Sep 16 15:12:39.040094 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:12:39.040008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:12:39.905849 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:12:39.905802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:12:41.470690 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:12:41.470655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:13:08.817928 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:08.817884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:13:16.420529 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:16.420493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:13:18.813734 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:18.813695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:13:24.933722 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:24.933685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:13:43.222080 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:43.222046    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:13:49.817020 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:49.816984    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:13:53.048749 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.048710    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 15:13:53.049308 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.048978    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" podUID="5a137f9e-693b-4353-b377-7917162886df" containerName="manager" containerID="cri-o://f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f" gracePeriod=10
Sep 16 15:13:53.403877 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.403853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 15:13:53.479252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.479216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume\") pod \"5a137f9e-693b-4353-b377-7917162886df\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") "
Sep 16 15:13:53.479443 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.479340    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7m6dw\" (UniqueName: \"kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw\") pod \"5a137f9e-693b-4353-b377-7917162886df\" (UID: \"5a137f9e-693b-4353-b377-7917162886df\") "
Sep 16 15:13:53.479601 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.479573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5a137f9e-693b-4353-b377-7917162886df" (UID: "5a137f9e-693b-4353-b377-7917162886df"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 15:13:53.481491 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.481466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw" (OuterVolumeSpecName: "kube-api-access-7m6dw") pod "5a137f9e-693b-4353-b377-7917162886df" (UID: "5a137f9e-693b-4353-b377-7917162886df"). InnerVolumeSpecName "kube-api-access-7m6dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:13:53.580751 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.580649    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7m6dw\" (UniqueName: \"kubernetes.io/projected/5a137f9e-693b-4353-b377-7917162886df-kube-api-access-7m6dw\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:13:53.580751 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.580683    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5a137f9e-693b-4353-b377-7917162886df-extensions-socket-volume\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:13:53.610985 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.610923    2565 generic.go:356] "Generic (PLEG): container finished" podID="5a137f9e-693b-4353-b377-7917162886df" containerID="f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f" exitCode=0
Sep 16 15:13:53.611160 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.610996    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"
Sep 16 15:13:53.611160 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.611009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" event={"ID":"5a137f9e-693b-4353-b377-7917162886df","Type":"ContainerDied","Data":"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"}
Sep 16 15:13:53.611160 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.611061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf" event={"ID":"5a137f9e-693b-4353-b377-7917162886df","Type":"ContainerDied","Data":"b67ca19e5ca0638abc38205ebcb517dc93fb2a6ceb21e94cbdf49af13cd3073a"}
Sep 16 15:13:53.611160 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.611083    2565 scope.go:117] "RemoveContainer" containerID="f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"
Sep 16 15:13:53.619947 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.619917    2565 scope.go:117] "RemoveContainer" containerID="f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"
Sep 16 15:13:53.620249 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:13:53.620228    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f\": container with ID starting with f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f not found: ID does not exist" containerID="f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"
Sep 16 15:13:53.620325 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.620256    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f"} err="failed to get container status \"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f\": rpc error: code = NotFound desc = could not find container \"f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f\": container with ID starting with f914226439a7f273befeb6f61e770df6c672224db5999e0bddb2a414bb40e04f not found: ID does not exist"
Sep 16 15:13:53.628051 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.628025    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 15:13:53.632322 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:53.632298    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-ckmdf"]
Sep 16 15:13:55.487236 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:13:55.487208    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a137f9e-693b-4353-b377-7917162886df" path="/var/lib/kubelet/pods/5a137f9e-693b-4353-b377-7917162886df/volumes"
Sep 16 15:14:27.532291 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:27.532256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:14:27.597730 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:27.597699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:14:53.831502 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831469    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"]
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831818    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67daa05-ad86-4b4d-bc92-71abb558d564" containerName="payload-pre-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831829    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67daa05-ad86-4b4d-bc92-71abb558d564" containerName="payload-pre-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831840    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831845    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831852    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" containerName="payload-pre-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831859    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" containerName="payload-pre-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831866    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831871    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831880    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831884    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a137f9e-693b-4353-b377-7917162886df" containerName="manager"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831905    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a137f9e-693b-4353-b377-7917162886df" containerName="manager"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831912    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77939086-6bcc-4231-b65f-0ec7f9b12e87" containerName="maas-api"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831917    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="77939086-6bcc-4231-b65f-0ec7f9b12e87" containerName="maas-api"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831924    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerName="maas-api"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831929    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerName="maas-api"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831948    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerName="payload-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831954    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerName="payload-processing"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831960    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:14:53.831966 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.831965    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832024    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a137f9e-693b-4353-b377-7917162886df" containerName="manager"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832033    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832042    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832053    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832058    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7168a87-ad9a-4fe2-8d31-d85e75b7fe6c" containerName="payload-pre-processing"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832063    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9962ca0c-ba12-47db-91b2-af01e9db9dda" containerName="maas-api"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832068    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67daa05-ad86-4b4d-bc92-71abb558d564" containerName="payload-pre-processing"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832073    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="77939086-6bcc-4231-b65f-0ec7f9b12e87" containerName="maas-api"
Sep 16 15:14:53.832588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.832080    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2446519-913d-4501-bc22-df43ceb3bf5a" containerName="payload-processing"
Sep 16 15:14:53.835089 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.835073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.838135 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.838113    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cqs5g\""
Sep 16 15:14:53.844005 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.843983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"]
Sep 16 15:14:53.880072 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.880038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/887172b5-b39e-4542-b862-f4990fa0fa18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.880072 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.880076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxz95\" (UniqueName: \"kubernetes.io/projected/887172b5-b39e-4542-b862-f4990fa0fa18-kube-api-access-nxz95\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.981480 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.981442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/887172b5-b39e-4542-b862-f4990fa0fa18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.981480 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.981485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxz95\" (UniqueName: \"kubernetes.io/projected/887172b5-b39e-4542-b862-f4990fa0fa18-kube-api-access-nxz95\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.981899 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.981875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/887172b5-b39e-4542-b862-f4990fa0fa18-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:53.990769 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:53.990737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxz95\" (UniqueName: \"kubernetes.io/projected/887172b5-b39e-4542-b862-f4990fa0fa18-kube-api-access-nxz95\") pod \"kuadrant-operator-controller-manager-5769f99d9f-q7tsc\" (UID: \"887172b5-b39e-4542-b862-f4990fa0fa18\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:54.145377 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.145286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:54.426279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.426187    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"]
Sep 16 15:14:54.429477 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:14:54.429451    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887172b5_b39e_4542_b862_f4990fa0fa18.slice/crio-68740214bed2a6d33132e1a0cb820587621ca074ce156f3f6956b962784944c5 WatchSource:0}: Error finding container 68740214bed2a6d33132e1a0cb820587621ca074ce156f3f6956b962784944c5: Status 404 returned error can't find the container with id 68740214bed2a6d33132e1a0cb820587621ca074ce156f3f6956b962784944c5
Sep 16 15:14:54.911364 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.911330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc" event={"ID":"887172b5-b39e-4542-b862-f4990fa0fa18","Type":"ContainerStarted","Data":"d4832c36d4d726567949da65f0a5a8926556a4fee119935d3038c075139b7365"}
Sep 16 15:14:54.911750 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.911388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:14:54.911750 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.911406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc" event={"ID":"887172b5-b39e-4542-b862-f4990fa0fa18","Type":"ContainerStarted","Data":"68740214bed2a6d33132e1a0cb820587621ca074ce156f3f6956b962784944c5"}
Sep 16 15:14:54.979741 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:14:54.979680    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc" podStartSLOduration=1.979658753 podStartE2EDuration="1.979658753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:14:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:14:54.979395798 +0000 UTC m=+2390.080871252" watchObservedRunningTime="2026-09-16 15:14:54.979658753 +0000 UTC m=+2390.081134206"
Sep 16 15:15:05.547072 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:05.547040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:15:05.556174 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:05.556147    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:15:05.919355 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:05.919270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-q7tsc"
Sep 16 15:15:17.115784 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:17.115747    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:15:22.822037 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:22.822001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:15:31.014630 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:31.014549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:15:35.637415 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:35.637367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:15:44.873188 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:44.873146    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:15:47.226638 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:47.226599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:15:49.573423 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:49.573389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:15:57.316880 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:15:57.316843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:16:25.280557 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:25.280507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:16:26.636321 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:26.636278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:16:27.353380 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:27.353344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:16:28.026334 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:28.026302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:16:36.717584 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:36.717548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:16:46.017152 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.017118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:16:46.303830 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.303747    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:16:46.304154 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304138    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:16:46.304205 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304157    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:16:46.304205 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304188    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:16:46.304205 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304194    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:16:46.304307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304252    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f832460b-5e61-4dbf-ada5-4170a55671ca" containerName="istio-proxy"
Sep 16 15:16:46.304307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304261    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="220f6eaa-12a1-4627-8bc1-62a52b90a03a" containerName="istio-proxy"
Sep 16 15:16:46.304307 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.304268    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc5518b-d014-46f5-aecd-8caa57e6e896" containerName="istio-proxy"
Sep 16 15:16:46.307262 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.307246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.311126 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.311107    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 15:16:46.312197 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.312177    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2cp94\""
Sep 16 15:16:46.312318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.312215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 15:16:46.312318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.312255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 15:16:46.312318 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.312220    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 15:16:46.320711 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.320689    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:16:46.353792 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.353764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.353917 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.353843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.353998 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.353979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.354046 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.354021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcphr\" (UniqueName: \"kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.455436 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.455406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.455436 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.455442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcphr\" (UniqueName: \"kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.455668 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.455473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.455668 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.455511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.456290 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.456263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.458033 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.458012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.458473 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.458453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.463311 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.463287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcphr\" (UniqueName: \"kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr\") pod \"maas-api-5665c7f4f4-44csd\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") " pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.617593 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.617511    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:46.890124 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.890077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:16:46.892450 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:16:46.892424    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fb16fd_f504_4ee8_82dc_95714acf3383.slice/crio-1af1860dc42636d0c9203b5edf92510d66d092ccc85786ba1da533bb2f5a2168 WatchSource:0}: Error finding container 1af1860dc42636d0c9203b5edf92510d66d092ccc85786ba1da533bb2f5a2168: Status 404 returned error can't find the container with id 1af1860dc42636d0c9203b5edf92510d66d092ccc85786ba1da533bb2f5a2168
Sep 16 15:16:46.893789 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:46.893770    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 15:16:47.465190 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:47.465152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" event={"ID":"78fb16fd-f504-4ee8-82dc-95714acf3383","Type":"ContainerStarted","Data":"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"}
Sep 16 15:16:47.465548 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:47.465216    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" event={"ID":"78fb16fd-f504-4ee8-82dc-95714acf3383","Type":"ContainerStarted","Data":"1af1860dc42636d0c9203b5edf92510d66d092ccc85786ba1da533bb2f5a2168"}
Sep 16 15:16:47.465548 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:47.465338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:53.475924 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:53.475891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:16:53.495790 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:53.495744    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" podStartSLOduration=7.080201927 podStartE2EDuration="7.495730315s" totalImagesPullingTime="415.528388ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:16:47.514383523 +0000 UTC m=+2502.615858976" watchObservedRunningTime="2026-09-16 15:16:53.495730315 +0000 UTC m=+2508.597205768"
Sep 16 15:16:53.809104 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:53.809070    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:16:54.036185 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.036146    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-tq757"]
Sep 16 15:16:54.039791 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.039775    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.052407 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.052339    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-tq757"]
Sep 16 15:16:54.129863 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.129781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0173f3ec-2f45-4542-89bf-3e8dbaa75318-openshift-service-ca\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.129863 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.129826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2x5\" (UniqueName: \"kubernetes.io/projected/0173f3ec-2f45-4542-89bf-3e8dbaa75318-kube-api-access-dw2x5\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.130082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.129864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-maas-api-tls\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.130082 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.129986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-metrics-certs\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.231279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.231244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-maas-api-tls\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.231279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.231282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-metrics-certs\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.231508 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.231332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0173f3ec-2f45-4542-89bf-3e8dbaa75318-openshift-service-ca\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.231508 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.231359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2x5\" (UniqueName: \"kubernetes.io/projected/0173f3ec-2f45-4542-89bf-3e8dbaa75318-kube-api-access-dw2x5\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.232003 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.231980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0173f3ec-2f45-4542-89bf-3e8dbaa75318-openshift-service-ca\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.233667 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.233637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-metrics-certs\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.233824 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.233805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0173f3ec-2f45-4542-89bf-3e8dbaa75318-maas-api-tls\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.240145 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.240126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2x5\" (UniqueName: \"kubernetes.io/projected/0173f3ec-2f45-4542-89bf-3e8dbaa75318-kube-api-access-dw2x5\") pod \"maas-api-5449d58978-tq757\" (UID: \"0173f3ec-2f45-4542-89bf-3e8dbaa75318\") " pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.350454 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.350415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:54.628285 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:54.628261    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5449d58978-tq757"]
Sep 16 15:16:54.630292 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:16:54.630265    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0173f3ec_2f45_4542_89bf_3e8dbaa75318.slice/crio-5251cc82ebc008cafaeb76033403d7e3ab94762bbb307663dd8e2c9314631ab8 WatchSource:0}: Error finding container 5251cc82ebc008cafaeb76033403d7e3ab94762bbb307663dd8e2c9314631ab8: Status 404 returned error can't find the container with id 5251cc82ebc008cafaeb76033403d7e3ab94762bbb307663dd8e2c9314631ab8
Sep 16 15:16:55.502362 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:55.502324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757" event={"ID":"0173f3ec-2f45-4542-89bf-3e8dbaa75318","Type":"ContainerStarted","Data":"382e4e76be8ce4af4ad0e09f33ff3ef40a08bca8ecab7665b63a0b520ab7d5d1"}
Sep 16 15:16:55.502362 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:55.502371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757" event={"ID":"0173f3ec-2f45-4542-89bf-3e8dbaa75318","Type":"ContainerStarted","Data":"5251cc82ebc008cafaeb76033403d7e3ab94762bbb307663dd8e2c9314631ab8"}
Sep 16 15:16:55.502679 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:55.502408    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:16:55.522051 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:16:55.521997    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757" podStartSLOduration=1.213161864 podStartE2EDuration="1.521979327s" totalImagesPullingTime="308.817463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:16:55.520561754 +0000 UTC m=+2510.622037233" watchObservedRunningTime="2026-09-16 15:16:55.521979327 +0000 UTC m=+2510.623454772"
Sep 16 15:17:00.918564 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:00.918480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:17:01.518736 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.518702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5449d58978-tq757"
Sep 16 15:17:01.573268 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.573232    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:17:01.573487 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.573462    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" podUID="78fb16fd-f504-4ee8-82dc-95714acf3383" containerName="maas-api" containerID="cri-o://704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9" gracePeriod=30
Sep 16 15:17:01.825566 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.825543    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:17:01.899628 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.899594    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcphr\" (UniqueName: \"kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr\") pod \"78fb16fd-f504-4ee8-82dc-95714acf3383\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") "
Sep 16 15:17:01.899794 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.899657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls\") pod \"78fb16fd-f504-4ee8-82dc-95714acf3383\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") "
Sep 16 15:17:01.899794 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.899715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs\") pod \"78fb16fd-f504-4ee8-82dc-95714acf3383\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") "
Sep 16 15:17:01.899794 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.899734    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca\") pod \"78fb16fd-f504-4ee8-82dc-95714acf3383\" (UID: \"78fb16fd-f504-4ee8-82dc-95714acf3383\") "
Sep 16 15:17:01.900141 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.900112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78fb16fd-f504-4ee8-82dc-95714acf3383" (UID: "78fb16fd-f504-4ee8-82dc-95714acf3383"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 15:17:01.901726 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.901693    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78fb16fd-f504-4ee8-82dc-95714acf3383" (UID: "78fb16fd-f504-4ee8-82dc-95714acf3383"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:17:01.901726 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.901713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "78fb16fd-f504-4ee8-82dc-95714acf3383" (UID: "78fb16fd-f504-4ee8-82dc-95714acf3383"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 15:17:01.901881 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:01.901719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr" (OuterVolumeSpecName: "kube-api-access-tcphr") pod "78fb16fd-f504-4ee8-82dc-95714acf3383" (UID: "78fb16fd-f504-4ee8-82dc-95714acf3383"). InnerVolumeSpecName "kube-api-access-tcphr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 15:17:02.000490 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.000453    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcphr\" (UniqueName: \"kubernetes.io/projected/78fb16fd-f504-4ee8-82dc-95714acf3383-kube-api-access-tcphr\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:17:02.000490 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.000485    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-maas-api-tls\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:17:02.000490 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.000495    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78fb16fd-f504-4ee8-82dc-95714acf3383-metrics-certs\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:17:02.000920 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.000502    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78fb16fd-f504-4ee8-82dc-95714acf3383-openshift-service-ca\") on node \"ip-10-0-136-124.ec2.internal\" DevicePath \"\""
Sep 16 15:17:02.541071 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.541032    2565 generic.go:356] "Generic (PLEG): container finished" podID="78fb16fd-f504-4ee8-82dc-95714acf3383" containerID="704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9" exitCode=0
Sep 16 15:17:02.541253 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.541079    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"
Sep 16 15:17:02.541253 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.541090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" event={"ID":"78fb16fd-f504-4ee8-82dc-95714acf3383","Type":"ContainerDied","Data":"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"}
Sep 16 15:17:02.541253 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.541140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd" event={"ID":"78fb16fd-f504-4ee8-82dc-95714acf3383","Type":"ContainerDied","Data":"1af1860dc42636d0c9203b5edf92510d66d092ccc85786ba1da533bb2f5a2168"}
Sep 16 15:17:02.541253 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.541168    2565 scope.go:117] "RemoveContainer" containerID="704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"
Sep 16 15:17:02.550271 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.550238    2565 scope.go:117] "RemoveContainer" containerID="704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"
Sep 16 15:17:02.550547 ip-10-0-136-124 kubenswrapper[2565]: E0916 15:17:02.550529    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9\": container with ID starting with 704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9 not found: ID does not exist" containerID="704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"
Sep 16 15:17:02.550611 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.550557    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9"} err="failed to get container status \"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9\": rpc error: code = NotFound desc = could not find container \"704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9\": container with ID starting with 704c23b51597948732a9692fa1656c1ebf915b8b283bb1adbff8cd242a4b89e9 not found: ID does not exist"
Sep 16 15:17:02.562117 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.562087    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:17:02.566070 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:02.566050    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5665c7f4f4-44csd"]
Sep 16 15:17:03.487894 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:03.487860    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78fb16fd-f504-4ee8-82dc-95714acf3383" path="/var/lib/kubelet/pods/78fb16fd-f504-4ee8-82dc-95714acf3383/volumes"
Sep 16 15:17:08.926639 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:08.926599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:17:14.022762 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:14.022725    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-wnrf4"]
Sep 16 15:17:22.433438 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:22.433405    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8j7xp_d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca/manager/0.log"
Sep 16 15:17:22.554794 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:22.554762    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fbjg2_8b9b8780-44dc-45a2-8b78-d7a77e7924a2/manager/0.log"
Sep 16 15:17:23.261152 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:23.261125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-cvtsg_9d813516-f641-420d-a4af-b3c67c4595a6/copy-manifests/0.log"
Sep 16 15:17:23.280917 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:23.280887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-cvtsg_9d813516-f641-420d-a4af-b3c67c4595a6/manager/0.log"
Sep 16 15:17:23.723979 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:23.723882    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5449d58978-tq757_0173f3ec-2f45-4542-89bf-3e8dbaa75318/maas-api/0.log"
Sep 16 15:17:24.975131 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:24.975099    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-f9c7m_5f463ddf-22dd-48fd-a122-bb8fe64adbf7/manager/0.log"
Sep 16 15:17:25.085634 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:25.085601    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mnmfs_3ddc8d75-ace4-4c33-8dd2-1abfeec2c700/manager/0.log"
Sep 16 15:17:25.316011 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:25.315980    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-q7tsc_887172b5-b39e-4542-b862-f4990fa0fa18/manager/0.log"
Sep 16 15:17:25.444214 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:25.444181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-wnrf4_f1d0833b-dee2-4fc7-b797-6ee45a24a3b8/limitador/0.log"
Sep 16 15:17:25.562742 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:25.562701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-2m4q7_87bdea90-382f-4dbd-9601-9bc1315dc1f9/manager/0.log"
Sep 16 15:17:26.235039 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:26.235011    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d79898bc9-vqnp5_ba09fcf5-28ce-40e2-8621-6d576cd47971/kube-auth-proxy/0.log"
Sep 16 15:17:26.700194 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:26.700161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff77fd8c6-khqvt_47edf677-aed3-4b53-a03b-f2d89d8fb5c8/router/0.log"
Sep 16 15:17:27.035100 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:27.035071    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xdv2n_2788587b-dd68-41e1-9e76-9a4ea3e06c2c/main/0.log"
Sep 16 15:17:27.368181 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:27.368102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-f9w5l_e641007c-31cd-41f6-8333-66c5db42c44c/main/0.log"
Sep 16 15:17:33.154038 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.153999    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m9cp/must-gather-b9z9g"]
Sep 16 15:17:33.154498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.154396    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78fb16fd-f504-4ee8-82dc-95714acf3383" containerName="maas-api"
Sep 16 15:17:33.154498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.154408    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="78fb16fd-f504-4ee8-82dc-95714acf3383" containerName="maas-api"
Sep 16 15:17:33.154498 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.154476    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="78fb16fd-f504-4ee8-82dc-95714acf3383" containerName="maas-api"
Sep 16 15:17:33.158147 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.158125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.159440 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.159413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:17:33.161034 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.161006    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m9cp\"/\"openshift-service-ca.crt\""
Sep 16 15:17:33.161198 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.161177    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m9cp\"/\"kube-root-ca.crt\""
Sep 16 15:17:33.161849 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.161835    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m9cp\"/\"default-dockercfg-kx9vz\""
Sep 16 15:17:33.167154 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.167130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/must-gather-b9z9g"]
Sep 16 15:17:33.231823 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.231775    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log" limit=1024
Sep 16 15:17:33.273129 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.273090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fe68a9c-b8f2-45c5-97f2-31de360b224f-must-gather-output\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.273298 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.273198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhz8b\" (UniqueName: \"kubernetes.io/projected/3fe68a9c-b8f2-45c5-97f2-31de360b224f-kube-api-access-fhz8b\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.374281 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.374241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhz8b\" (UniqueName: \"kubernetes.io/projected/3fe68a9c-b8f2-45c5-97f2-31de360b224f-kube-api-access-fhz8b\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.374484 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.374301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fe68a9c-b8f2-45c5-97f2-31de360b224f-must-gather-output\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.374610 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.374585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3fe68a9c-b8f2-45c5-97f2-31de360b224f-must-gather-output\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.383464 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.383436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhz8b\" (UniqueName: \"kubernetes.io/projected/3fe68a9c-b8f2-45c5-97f2-31de360b224f-kube-api-access-fhz8b\") pod \"must-gather-b9z9g\" (UID: \"3fe68a9c-b8f2-45c5-97f2-31de360b224f\") " pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.468279 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.468190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/must-gather-b9z9g"
Sep 16 15:17:33.740319 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:33.740298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/must-gather-b9z9g"]
Sep 16 15:17:33.742384 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:17:33.742356    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fe68a9c_b8f2_45c5_97f2_31de360b224f.slice/crio-7af42fdbf53ab4a8c4b4d56bde294b5ff62de433d8764deca156ed6ce02f601c WatchSource:0}: Error finding container 7af42fdbf53ab4a8c4b4d56bde294b5ff62de433d8764deca156ed6ce02f601c: Status 404 returned error can't find the container with id 7af42fdbf53ab4a8c4b4d56bde294b5ff62de433d8764deca156ed6ce02f601c
Sep 16 15:17:34.702588 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:34.702557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/must-gather-b9z9g" event={"ID":"3fe68a9c-b8f2-45c5-97f2-31de360b224f","Type":"ContainerStarted","Data":"7af42fdbf53ab4a8c4b4d56bde294b5ff62de433d8764deca156ed6ce02f601c"}
Sep 16 15:17:35.711912 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:35.711876    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/must-gather-b9z9g" event={"ID":"3fe68a9c-b8f2-45c5-97f2-31de360b224f","Type":"ContainerStarted","Data":"8ccc3b92113a5fda542b72feeae83f54a9e3372728a9f7b484caf0e029a0ddd7"}
Sep 16 15:17:35.711912 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:35.711919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/must-gather-b9z9g" event={"ID":"3fe68a9c-b8f2-45c5-97f2-31de360b224f","Type":"ContainerStarted","Data":"7839d029c50c7135cf61db1cf133112cd762e9f8b2e2372f45448de0e89ca5c8"}
Sep 16 15:17:35.730086 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:35.730018    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m9cp/must-gather-b9z9g" podStartSLOduration=1.847007508 podStartE2EDuration="2.729995007s" totalImagesPullingTime="882.987499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 15:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:17:35.728213088 +0000 UTC m=+2550.829688542" watchObservedRunningTime="2026-09-16 15:17:35.729995007 +0000 UTC m=+2550.831470460"
Sep 16 15:17:36.357519 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:36.357486    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tkv5q_8bf35fc1-8936-4784-a329-fe71c5357342/global-pull-secret-syncer/0.log"
Sep 16 15:17:36.421484 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:36.421429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6b8lf_fbcde4ed-12ca-4321-8675-2e40dfcffc6f/konnectivity-agent/0.log"
Sep 16 15:17:36.561252 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:36.561218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-124.ec2.internal_00d462eff659027c761e729fec4016c1/haproxy/0.log"
Sep 16 15:17:41.160987 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:41.160952    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-f9c7m_5f463ddf-22dd-48fd-a122-bb8fe64adbf7/manager/0.log"
Sep 16 15:17:41.207806 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:41.207768    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-mnmfs_3ddc8d75-ace4-4c33-8dd2-1abfeec2c700/manager/0.log"
Sep 16 15:17:41.287036 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:41.286999    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-q7tsc_887172b5-b39e-4542-b862-f4990fa0fa18/manager/0.log"
Sep 16 15:17:41.317527 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:41.317500    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-wnrf4_f1d0833b-dee2-4fc7-b797-6ee45a24a3b8/limitador/0.log"
Sep 16 15:17:41.394060 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:41.393960    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-2m4q7_87bdea90-382f-4dbd-9601-9bc1315dc1f9/manager/0.log"
Sep 16 15:17:43.042391 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:43.042353    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-pmj4h_d90610ec-e1a6-4c4d-8424-7810501903ea/cluster-monitoring-operator/0.log"
Sep 16 15:17:43.249227 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:43.249180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xkkn_894fb037-2f78-4077-a54f-3d8effccf01c/node-exporter/0.log"
Sep 16 15:17:43.282520 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:43.282481    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xkkn_894fb037-2f78-4077-a54f-3d8effccf01c/kube-rbac-proxy/0.log"
Sep 16 15:17:43.313749 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:43.313671    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2xkkn_894fb037-2f78-4077-a54f-3d8effccf01c/init-textfile/0.log"
Sep 16 15:17:45.529928 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:45.529896    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-8mmdd_77ab014f-8301-44c4-b786-840dbe71dd74/networking-console-plugin/0.log"
Sep 16 15:17:46.125768 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.125735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/1.log"
Sep 16 15:17:46.132765 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.132720    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-tzr95_915fdd91-6a41-4983-a853-1990edf3ecd6/console-operator/2.log"
Sep 16 15:17:46.343462 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.343421    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"]
Sep 16 15:17:46.352219 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.352188    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.360746 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.360713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"]
Sep 16 15:17:46.524143 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.524106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92ml\" (UniqueName: \"kubernetes.io/projected/691270b8-fb61-4cb2-b037-28dd27c1c7be-kube-api-access-d92ml\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.524475 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.524449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-proc\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.524599 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.524482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-podres\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.524599 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.524543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-lib-modules\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.524599 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.524593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-sys\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-proc\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-podres\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-lib-modules\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-sys\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92ml\" (UniqueName: \"kubernetes.io/projected/691270b8-fb61-4cb2-b037-28dd27c1c7be-kube-api-access-d92ml\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-sys\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-proc\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.636959 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.636923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-podres\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.637768 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.637247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/691270b8-fb61-4cb2-b037-28dd27c1c7be-lib-modules\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.648682 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.648126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92ml\" (UniqueName: \"kubernetes.io/projected/691270b8-fb61-4cb2-b037-28dd27c1c7be-kube-api-access-d92ml\") pod \"perf-node-gather-daemonset-b549b\" (UID: \"691270b8-fb61-4cb2-b037-28dd27c1c7be\") " pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.664323 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.664297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:46.804867 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.804657    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-b5xvk_8585dd39-eccd-4014-b4a0-d35fdeaca3e8/download-server/0.log"
Sep 16 15:17:46.954598 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:46.954559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"]
Sep 16 15:17:46.959705 ip-10-0-136-124 kubenswrapper[2565]: W0916 15:17:46.959672    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod691270b8_fb61_4cb2_b037_28dd27c1c7be.slice/crio-88827cb5867500ce0f6cb1d6aa0d5f7fb45d52929352963943efbd7550b4c436 WatchSource:0}: Error finding container 88827cb5867500ce0f6cb1d6aa0d5f7fb45d52929352963943efbd7550b4c436: Status 404 returned error can't find the container with id 88827cb5867500ce0f6cb1d6aa0d5f7fb45d52929352963943efbd7550b4c436
Sep 16 15:17:47.474304 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:47.474204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-8pg8z_064ea5f2-ea84-47af-9dfa-2340de7b94c9/volume-data-source-validator/0.log"
Sep 16 15:17:47.809165 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:47.809119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b" event={"ID":"691270b8-fb61-4cb2-b037-28dd27c1c7be","Type":"ContainerStarted","Data":"18eecb51796dea85e2c15bd48da10d6243448e7e9c4f47ade78c4f9f2d735313"}
Sep 16 15:17:47.809670 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:47.809192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b" event={"ID":"691270b8-fb61-4cb2-b037-28dd27c1c7be","Type":"ContainerStarted","Data":"88827cb5867500ce0f6cb1d6aa0d5f7fb45d52929352963943efbd7550b4c436"}
Sep 16 15:17:47.809670 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:47.809327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:47.828327 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:47.828275    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b" podStartSLOduration=1.828254581 podStartE2EDuration="1.828254581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 15:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 15:17:47.827365234 +0000 UTC m=+2562.928840688" watchObservedRunningTime="2026-09-16 15:17:47.828254581 +0000 UTC m=+2562.929730034"
Sep 16 15:17:48.622246 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:48.622213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ngzql_3ee543e3-bb68-472a-a025-a9b7386e8839/dns/0.log"
Sep 16 15:17:48.678342 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:48.678294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ngzql_3ee543e3-bb68-472a-a025-a9b7386e8839/kube-rbac-proxy/0.log"
Sep 16 15:17:48.869768 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:48.869737    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t8x6z_98b0e16d-aeef-4155-8ea8-54d4ffd3131b/dns-node-resolver/0.log"
Sep 16 15:17:49.439187 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:49.439147    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s2vwg_74dcc4de-7619-4c93-abf9-2e2e771c3c27/node-ca/0.log"
Sep 16 15:17:50.887875 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:50.887845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d79898bc9-vqnp5_ba09fcf5-28ce-40e2-8621-6d576cd47971/kube-auth-proxy/0.log"
Sep 16 15:17:51.115245 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:51.115212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff77fd8c6-khqvt_47edf677-aed3-4b53-a03b-f2d89d8fb5c8/router/0.log"
Sep 16 15:17:52.053298 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.053265    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zfbld_52a53c3c-043f-48ca-bb14-e6c6ac20492a/serve-healthcheck-canary/0.log"
Sep 16 15:17:52.598313 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.598278    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-fjrq7_19c209c8-b20a-4dc8-aba9-d58efc443f30/insights-operator/0.log"
Sep 16 15:17:52.601589 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.601563    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-fjrq7_19c209c8-b20a-4dc8-aba9-d58efc443f30/insights-operator/1.log"
Sep 16 15:17:52.696390 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.696356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbwqq_0420fa52-f086-48b1-b582-5f10b1c9cfca/kube-rbac-proxy/0.log"
Sep 16 15:17:52.741382 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.741351    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbwqq_0420fa52-f086-48b1-b582-5f10b1c9cfca/exporter/0.log"
Sep 16 15:17:52.766391 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:52.766361    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cbwqq_0420fa52-f086-48b1-b582-5f10b1c9cfca/extractor/0.log"
Sep 16 15:17:53.828964 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:53.828920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m9cp/perf-node-gather-daemonset-b549b"
Sep 16 15:17:55.044437 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:55.044403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8j7xp_d88d406b-b7ea-4f44-8a9a-f2c6af8a34ca/manager/0.log"
Sep 16 15:17:55.558256 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:55.558159    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fbjg2_8b9b8780-44dc-45a2-8b78-d7a77e7924a2/manager/0.log"
Sep 16 15:17:56.159666 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:56.159581    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-cvtsg_9d813516-f641-420d-a4af-b3c67c4595a6/manager/0.log"
Sep 16 15:17:56.194417 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:56.194385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-846667779d-cvtsg_9d813516-f641-420d-a4af-b3c67c4595a6/copy-manifests/0.log"
Sep 16 15:17:56.841408 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:56.841380    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d79898bc9-vqnp5_ba09fcf5-28ce-40e2-8621-6d576cd47971/kube-auth-proxy/0.log"
Sep 16 15:17:56.921657 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:56.921631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff77fd8c6-khqvt_47edf677-aed3-4b53-a03b-f2d89d8fb5c8/router/0.log"
Sep 16 15:17:58.970090 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:58.970009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d79898bc9-vqnp5_ba09fcf5-28ce-40e2-8621-6d576cd47971/kube-auth-proxy/0.log"
Sep 16 15:17:59.060061 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:17:59.060026    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ff77fd8c6-khqvt_47edf677-aed3-4b53-a03b-f2d89d8fb5c8/router/0.log"
Sep 16 15:18:02.623732 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:18:02.623698    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z84rq_74c7d882-342f-4ebd-b3d2-10b9ad845caf/migrator/0.log"
Sep 16 15:18:02.648463 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:18:02.648437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-z84rq_74c7d882-342f-4ebd-b3d2-10b9ad845caf/graceful-termination/0.log"
Sep 16 15:18:03.004000 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:18:03.003970    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-f55xf_0d1c52d6-e464-4ead-ad7f-642bb908764a/kube-storage-version-migrator-operator/1.log"
Sep 16 15:18:03.005743 ip-10-0-136-124 kubenswrapper[2565]: I0916 15:18:03.005717    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-f55xf_0d1c52d6-e464-4ead-ad7f-642bb908764a/kube-storage-version-migrator-operator/0.log"