Sep 15 21:10:03.199869 ip-10-0-129-47 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 21:10:03.561766 ip-10-0-129-47 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:10:03.561766 ip-10-0-129-47 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 21:10:03.561766 ip-10-0-129-47 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:10:03.561766 ip-10-0-129-47 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 21:10:03.561766 ip-10-0-129-47 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 21:10:03.563491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.563415    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 21:10:03.566864 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566850    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.566864 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566865    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566868    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566872    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566875    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566877    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566880    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566886    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566890    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566893    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566896    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566899    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566903    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566906    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566908    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566911    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566913    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566916    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566918    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.566925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566931    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566935    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566938    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566941    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566943    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566946    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566948    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566950    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566953    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566955    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566958    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566960    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566963    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566965    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566967    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566970    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566972    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566975    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566977    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566980    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.567339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566983    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566985    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566987    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566990    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566992    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566995    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.566997    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567000    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567002    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567005    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567007    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567009    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567012    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567015    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567018    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567021    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567023    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567026    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567028    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567030    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.567822 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567034    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567036    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567040    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567044    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567047    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567049    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567052    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567054    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567057    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567059    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567062    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567065    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567068    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567071    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567073    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567076    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567079    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567081    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567084    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.568302 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567086    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567089    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567091    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567094    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567096    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567099    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567101    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567107    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567110    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567113    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567117    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567121    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567123    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567126    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567128    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567131    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567134    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567136    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567139    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567141    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.568769 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567144    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567824    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567833    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567837    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567841    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567844    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567847    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567850    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567853    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567855    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567858    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567860    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567863    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567865    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567868    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567870    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567873    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567875    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567878    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.569246 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567881    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567884    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567887    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567890    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567892    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567895    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567898    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567900    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567903    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567905    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567907    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567910    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567912    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567915    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567917    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567919    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567922    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567924    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567926    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567929    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.569733 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567932    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567934    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567937    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567941    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567945    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567948    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567950    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567953    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567956    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567959    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567962    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567965    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567968    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567971    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567973    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567976    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567978    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567981    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567983    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.570209 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567986    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567988    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567991    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567993    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567995    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.567998    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568000    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568003    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568006    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568009    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568011    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568013    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568016    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568018    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568021    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568024    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568026    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568029    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568032    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.570680 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568034    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568037    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568040    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568044    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568046    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568049    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568052    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568055    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568057    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568060    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568063    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568065    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568068    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568070    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568073    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568075    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568077    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568080    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568082    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.571213 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568084    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568087    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568089    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568092    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568432    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568437    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568439    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568442    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568445    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568448    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568450    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568453    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568455    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568458    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568461    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568463    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568466    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568468    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568472    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568475    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.571676 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568477    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568480    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568483    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568485    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568487    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568490    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568493    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568495    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568497    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568500    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568502    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568505    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568507    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568510    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568512    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568515    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568517    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568520    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568523    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568525    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.572175 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568528    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568531    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568533    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568535    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568538    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568540    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568543    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568547    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568551    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568554    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568557    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568559    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568562    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568564    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568567    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568569    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568571    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568574    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568576    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.572655 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568578    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568581    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568597    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568599    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568602    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568604    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568607    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568609    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568612    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568616    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568619    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568621    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568624    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568628    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568632    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568635    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568640    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568643    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568646    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568649    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.573101 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568651    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568654    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568657    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568659    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568662    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568664    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568667    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568669    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568672    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568675    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568678    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568681    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568685    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568688    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568691    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568693    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568696    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568699    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568702    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.573620 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568705    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568708    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568711    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568714    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.568717    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568790    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568820    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568826    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568830    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568837    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568840    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568845    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568849    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568852    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568855    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568858    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568861    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568864    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568867    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568870    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568873    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568876    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568879    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 21:10:03.574087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568883    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568886    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568889    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568892    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568895    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568898    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568901    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568904    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568907    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568910    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568913    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568918    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568921    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568924    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568930    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568933    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568936    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568939    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568943    2558 flags.go:64] FLAG: --enable-server="true"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568947    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568951    2558 flags.go:64] FLAG: --event-burst="100"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568954    2558 flags.go:64] FLAG: --event-qps="50"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568957    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568960    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 21:10:03.574627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568963    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568966    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568969    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568972    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568975    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568978    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568980    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568983    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568986    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568989    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568992    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568994    2558 flags.go:64] FLAG: --feature-gates=""
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.568998    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569001    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569004    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569007    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569010    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569013    2558 flags.go:64] FLAG: --help="false"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569016    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569020    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569023    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569026    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569029    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 21:10:03.575224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569033    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569036    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569038    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569042    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569045    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569049    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569052    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569055    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569058    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569060    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569063    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569066    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569069    2558 flags.go:64] FLAG: --lock-file=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569072    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569075    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569077    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569082    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569085    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569088    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569091    2558 flags.go:64] FLAG: --logging-format="text"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569093    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569097    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569100    2558 flags.go:64] FLAG: --manifest-url=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569102    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569106    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 21:10:03.575835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569109    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569113    2558 flags.go:64] FLAG: --max-pods="110"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569116    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569120    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569123    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569126    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569129    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569132    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569134    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569141    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569145    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569148    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569151    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569155    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569160    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569163    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569166    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569169    2558 flags.go:64] FLAG: --port="10250"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569172    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569174    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00275b580759901f8"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569177    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569181    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569183    2558 flags.go:64] FLAG: --register-node="true"
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569186    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 15 21:10:03.576429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569190    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569193    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569195    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569198    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569202    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569205    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569208    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569211    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569213    2558 flags.go:64] FLAG: --runonce="false"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569216    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569219    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569222    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569227    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569230    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569233    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569236    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569239    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569241    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569245    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569248    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569251    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569254    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569258    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569261    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569266    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 21:10:03.577028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569268    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569271    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569275    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569278    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569281    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569284    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569287    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569289    2558 flags.go:64] FLAG: --v="2"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569293    2558 flags.go:64] FLAG: --version="false"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569297    2558 flags.go:64] FLAG: --vmodule=""
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569300    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.569303    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569407    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569411    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569414    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569416    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569420    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569423    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569425    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569429    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569431    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569434    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569436    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.577640 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569439    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569443    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569447    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569450    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569452    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569455    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569458    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569462    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569465    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569468    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569471    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569473    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569476    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569478    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569481    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569483    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569486    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569488    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569491    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.578195 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569493    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569495    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569498    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569500    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569504    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569507    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569510    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569513    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569516    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569519    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569522    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569524    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569527    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569529    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569532    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569535    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569545    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569548    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569551    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569554    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.578696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569556    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569560    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569570    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569573    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569575    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569578    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569581    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569595    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569598    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569601    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569604    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569606    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569609    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569612    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569615    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569617    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569620    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569623    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569625    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.579151 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569628    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569631    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569634    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569636    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569639    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569641    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569644    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569647    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569649    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569652    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569655    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569657    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569660    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569663    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569665    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569668    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569671    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569673    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569676    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569679    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.579618 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569681    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569684    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569686    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569689    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569692    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569694    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569697    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569699    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569702    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.569704    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.570766    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.577029    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.577043    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.578361    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.578368    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 21:10:03.580357 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578422    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578426    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578430    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578432    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578435    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578438    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578442    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578446    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578448    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578451    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578453    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578456    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578458    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578461    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578463    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578466    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578468    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578471    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578473    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578476    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.580906 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578478    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578481    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578483    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578486    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578489    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578491    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578494    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578496    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578499    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578502    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578504    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578508    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578512    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578515    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578519    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578521    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578524    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578527    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578531    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.581418 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578535    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578537    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578540    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578543    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578545    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578548    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578551    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578553    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578556    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578558    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578561    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578564    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578567    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578569    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578572    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578574    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578577    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578579    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578595    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578598    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.581925 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578600    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578603    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578606    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578609    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578611    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578614    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578617    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578620    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578622    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578625    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578628    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578630    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578633    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578635    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578638    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578641    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578644    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578646    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578649    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.582568 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578651    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578654    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578656    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578659    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578662    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578664    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578667    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578669    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578672    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578674    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578677    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578679    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578682    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578684    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578687    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578689    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578692    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578695    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578698    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578701    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.583085 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578704    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.578708    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578816    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578821    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578824    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578827    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578829    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578832    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578835    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578837    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578840    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578844    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578848    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578851    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578853    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 21:10:03.583555 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578856    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578858    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578861    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578864    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578866    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578869    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578873    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578876    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578879    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578882    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578884    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578887    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578890    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578892    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578895    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578899    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578901    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578904    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578907    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578910    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 21:10:03.583982 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578912    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578915    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578917    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578920    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578922    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578925    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578927    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578930    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578932    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578934    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578937    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578939    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578942    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578945    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578947    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578950    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578952    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578954    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578957    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578959    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 21:10:03.584458 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578962    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578964    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578967    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578969    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578972    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578974    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578976    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578979    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578982    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578984    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578988    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578990    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578992    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578995    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.578997    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579000    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579002    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579005    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579008    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579011    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 21:10:03.585042 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579014    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579017    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579019    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579021    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579024    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579026    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579029    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579032    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579034    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579036    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579039    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579042    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579044    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579046    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579049    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579052    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579054    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579056    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579060    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579062    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 21:10:03.585514 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579065    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579072    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579075    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579077    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579080    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:03.579082    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.579087    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.579176    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.583667    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.584536    2558 server.go:1019] "Starting client certificate rotation"
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.584649    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 21:10:03.586091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.584703    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 21:10:03.586785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.586772    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 21:10:03.587889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.587869    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 21:10:03.596599 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.596570    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 15 21:10:03.599374 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.599362    2558 log.go:25] "Validated CRI v1 image API"
Sep 15 21:10:03.600195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.600171    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 21:10:03.605087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.605069    2558 fs.go:135] Filesystem UUIDs: map[56fb2041-6a74-4958-bc27-13fda0446fc2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 82017c21-160b-4558-9e19-2ba95a887809:/dev/nvme0n1p3]
Sep 15 21:10:03.605160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.605087    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 21:10:03.609608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.609479    2558 manager.go:216] Machine: {Timestamp:2026-09-15 21:10:03.608340634 +0000 UTC m=+0.299398717 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3198534 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29bf603b439f67bdfbde59b8a3fd45 SystemUUID:ec29bf60-3b43-9f67-bdfb-de59b8a3fd45 BootID:3e772449-d2cb-4b99-97f8-180e514c4e3a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:7a:9a:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:7a:9a:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:b0:59:1d:b9:ed Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 21:10:03.609608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.609605    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 21:10:03.609761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.609699    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 21:10:03.612294 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.612268    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 21:10:03.612417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.612299    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 21:10:03.612870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.612859    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 21:10:03.612909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.612872    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 21:10:03.612909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.612885    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 21:10:03.613990 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.613980    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 21:10:03.615271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.615254    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 21:10:03.619149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619133    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 21:10:03.619277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619266    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 21:10:03.619337 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619307    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 21:10:03.619337 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619322    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 21:10:03.619418 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619340    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 21:10:03.619418 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619353    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 15 21:10:03.619418 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619364    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 21:10:03.619718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619705    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 21:10:03.619777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.619729    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 21:10:03.621650 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.621632    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 21:10:03.621901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.621886    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 21:10:03.623727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.623714    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 21:10:03.623778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.623743    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 21:10:03.625001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.624990    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625007    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625013    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625018    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625027    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625033    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625052    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625058    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625065    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 21:10:03.625068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625071    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 21:10:03.625290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625079    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 21:10:03.625290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625085    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 21:10:03.625829 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625819    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 21:10:03.625829 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.625829    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 21:10:03.629472 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.629454    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 21:10:03.629717 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.629706    2558 server.go:1268] "Started kubelet"
Sep 15 21:10:03.629791 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.629762    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 21:10:03.629910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.629876    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 21:10:03.629988 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.629928    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 21:10:03.630359 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.630326    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 21:10:03.630359 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.630326    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 21:10:03.630523 ip-10-0-129-47 systemd[1]: Started Kubernetes Kubelet.
Sep 15 21:10:03.630736 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.630724    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 21:10:03.631455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.631439    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 21:10:03.637175 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.637135    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 21:10:03.638211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.638196    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 21:10:03.638742 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.638719    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 21:10:03.638887 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.638871    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.639342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639325    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 21:10:03.639342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639328    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 21:10:03.639514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639352    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 21:10:03.639514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639466    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 21:10:03.639514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639476    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 21:10:03.639797 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.638388    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac658901eb0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.629682352 +0000 UTC m=+0.320740434,LastTimestamp:2026-09-15 21:10:03.629682352 +0000 UTC m=+0.320740434,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.639864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639805    2558 factory.go:153] Registering CRI-O factory
Sep 15 21:10:03.639864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639816    2558 factory.go:223] Registration of the crio container factory successfully
Sep 15 21:10:03.639864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639853    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 21:10:03.639864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639860    2558 factory.go:55] Registering systemd factory
Sep 15 21:10:03.639864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639865    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 15 21:10:03.640016 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639876    2558 factory.go:103] Registering Raw factory
Sep 15 21:10:03.640016 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.639885    2558 manager.go:1196] Started watching for new ooms in manager
Sep 15 21:10:03.640736 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.640712    2558 manager.go:349] Starting recovery of all containers
Sep 15 21:10:03.649838 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.649682    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 21:10:03.649939 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.649697    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 21:10:03.649939 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.649710    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 21:10:03.652484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.651919    2558 manager.go:354] Recovery completed
Sep 15 21:10:03.653238 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.653172    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 15 21:10:03.656239 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.656226    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.658010 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.657984    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.658074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658024    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.658074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658037    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.658714 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658698    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 21:10:03.658714 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658713    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 21:10:03.658845 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658730    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 21:10:03.658845 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.658764    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.659493 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.659476    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.659570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.659507    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.659570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.659522    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.660319 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.660251    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a405bd4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658009556 +0000 UTC m=+0.349067642,LastTimestamp:2026-09-15 21:10:03.658009556 +0000 UTC m=+0.349067642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.669903 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.669839    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a40ae37  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658030647 +0000 UTC m=+0.349088731,LastTimestamp:2026-09-15 21:10:03.658030647 +0000 UTC m=+0.349088731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.676095 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.676081    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-scb5t"
Sep 15 21:10:03.677695 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.677636    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a40ddf5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658042869 +0000 UTC m=+0.349100954,LastTimestamp:2026-09-15 21:10:03.658042869 +0000 UTC m=+0.349100954,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.681737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.681722    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-scb5t"
Sep 15 21:10:03.686266 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.686207    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-47.ec2.internal.18d59ac65a405bd4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a405bd4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658009556 +0000 UTC m=+0.349067642,LastTimestamp:2026-09-15 21:10:03.659492125 +0000 UTC m=+0.350550209,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.697024 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.696961    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-47.ec2.internal.18d59ac65a40ae37\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a40ae37  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658030647 +0000 UTC m=+0.349088731,LastTimestamp:2026-09-15 21:10:03.659513404 +0000 UTC m=+0.350571488,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.801307 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.707011    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-47.ec2.internal.18d59ac65a40ddf5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-47.ec2.internal.18d59ac65a40ddf5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-47.ec2.internal,UID:ip-10-0-129-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-47.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-47.ec2.internal,},FirstTimestamp:2026-09-15 21:10:03.658042869 +0000 UTC m=+0.349100954,LastTimestamp:2026-09-15 21:10:03.659527408 +0000 UTC m=+0.350585495,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-47.ec2.internal,}"
Sep 15 21:10:03.801307 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.739153    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.802176 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.802159    2558 policy_none.go:49] "None policy: Start"
Sep 15 21:10:03.802259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.802180    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 21:10:03.802259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.802193    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 21:10:03.804329 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.804315    2558 policy_none.go:47] "Start"
Sep 15 21:10:03.839148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839133    2558 manager.go:337] "Starting Device Plugin manager"
Sep 15 21:10:03.839230 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.839172    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 21:10:03.839230 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839184    2558 server.go:87] "Starting device plugin registration server"
Sep 15 21:10:03.839230 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.839216    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.839505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839494    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 21:10:03.839547 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839506    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 21:10:03.839630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839618    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 21:10:03.839701 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839690    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 21:10:03.839750 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.839701    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 21:10:03.840300 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.840272    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 21:10:03.840369 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.840334    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.857071 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.857047    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-47.ec2.internal\" not found" node="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.872499 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.872479    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 21:10:03.872580 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.872522    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 21:10:03.872580 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.872540    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 21:10:03.872671 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.872617    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 21:10:03.875304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.875287    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:10:03.939867 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.939847    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.940603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.940576    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.940662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.940618    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.940662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.940628    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.940662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.940647    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.949948 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.949929    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.950018 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.949955    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-47.ec2.internal\": node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.966137 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.966118    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:03.973111 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.973088    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"]
Sep 15 21:10:03.973160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.973150    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.973915 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.973896    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.974001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.973923    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.974001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.973936    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.976290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976278    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.976441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976429    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.976492 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976456    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.976913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976898    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.976913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976913    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.977017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976925    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.977017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976932    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.977017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976944    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.977017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.976935    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.979188 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.979176    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:03.979230 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.979196    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:03.979782 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.979768    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:03.979830 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.979793    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:03.979830 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:03.979804    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:03.996115 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:03.996095    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-47.ec2.internal\" not found" node="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:04.000376 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:04.000361    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-47.ec2.internal\" not found" node="ip-10-0-129-47.ec2.internal"
Sep 15 21:10:04.066263 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:04.066217    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:04.140813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:04.140795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:04.140894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:04.140825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:04.140894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:04.140849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1d1f32183c689b14f278b7c0504a490-config\") pod \"kube-apiserver-proxy-ip-10-0-129-47.ec2.internal\" (UID: \"a1d1f32183c689b14f278b7c0504a490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.250276 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.250247    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.324671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.324824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1d1f32183c689b14f278b7c0504a490-config\") pod \"kube-apiserver-proxy-ip-10-0-129-47.ec2.internal\" (UID: \"a1d1f32183c689b14f278b7c0504a490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.324824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.324824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324765    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.324824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2754d12e45f210ea1afde936560260d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal\" (UID: \"f2754d12e45f210ea1afde936560260d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.324824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.324772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a1d1f32183c689b14f278b7c0504a490-config\") pod \"kube-apiserver-proxy-ip-10-0-129-47.ec2.internal\" (UID: \"a1d1f32183c689b14f278b7c0504a490\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.350757 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.350735    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.381910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.381880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.386898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.386658    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:05.451749 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.451670    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.552135 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.552114    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.652584 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.652557    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.667712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.667688    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 21:10:05.667840 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.667824    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 21:10:05.752979 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.752910    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.818087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.818066    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 21:10:05.818942 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.818924    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 21:10:05.819059 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.818973    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 21:10:05.819059 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.818986    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeHasSufficientPID"
Sep 15 21:10:05.853120 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.853099    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.885290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.885244    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 21:05:04 +0000 UTC" deadline="2028-02-16 03:37:16.589787933 +0000 UTC"
Sep 15 21:10:05.885290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.885285    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12438h27m10.70450726s"
Sep 15 21:10:05.915014 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.914998    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:10:05.953443 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:05.953419    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-47.ec2.internal\" not found"
Sep 15 21:10:05.980930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:05.980907    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:10:06.022414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.022394    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:06.025197 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:06.025172    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d1f32183c689b14f278b7c0504a490.slice/crio-3458b165bb591251c8609ecb00728f6e3f708bc4b9501b1b3095ea1de7020868 WatchSource:0}: Error finding container 3458b165bb591251c8609ecb00728f6e3f708bc4b9501b1b3095ea1de7020868: Status 404 returned error can't find the container with id 3458b165bb591251c8609ecb00728f6e3f708bc4b9501b1b3095ea1de7020868
Sep 15 21:10:06.029623 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.029609    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:10:06.036597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.036580    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 21:10:06.037581 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.037566    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal"
Sep 15 21:10:06.046449 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.046434    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 21:10:06.104150 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:06.104126    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2754d12e45f210ea1afde936560260d.slice/crio-fe8e4b52d2e38ca86a181bc35277d69da9cad9f95c491104c95f8ef8b1bd6e06 WatchSource:0}: Error finding container fe8e4b52d2e38ca86a181bc35277d69da9cad9f95c491104c95f8ef8b1bd6e06: Status 404 returned error can't find the container with id fe8e4b52d2e38ca86a181bc35277d69da9cad9f95c491104c95f8ef8b1bd6e06
Sep 15 21:10:06.225569 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.225544    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:10:06.703304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.703273    2558 apiserver.go:52] "Watching apiserver"
Sep 15 21:10:06.709852 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.709829    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 21:10:06.710222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.710195    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-d9d6m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-57dd2","openshift-multus/multus-mftm6","openshift-network-diagnostics/network-check-target-9675j","openshift-ovn-kubernetes/ovnkube-node-s4ns5","kube-system/global-pull-secret-syncer-dtvm5","kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6pmsg","openshift-image-registry/node-ca-qjpnf","openshift-multus/network-metrics-daemon-v95z5","openshift-network-operator/iptables-alerter-zsj8z","kube-system/konnectivity-agent-5tp9j","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"]
Sep 15 21:10:06.712641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.712619    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.712755 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.712705    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:06.714716 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.714693    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.716826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.716805    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 21:10:06.717604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.717094    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 21:10:06.717604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.717098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wf4r\""
Sep 15 21:10:06.717604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.717282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.719541 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.718922    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.719541 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.719218    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.720033    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.720045    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-r5t9p\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.720314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.720364    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.720314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 21:10:06.721081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.721069    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 21:10:06.721385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.721206    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-plmfd\""
Sep 15 21:10:06.721385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.721316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:06.721478 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.721386    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:06.722411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.722391    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 21:10:06.724685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.723900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.726639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726605    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 21:10:06.726845 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726828    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726837    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726844    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726877    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726886    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.727723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.726920    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v5kc5\""
Sep 15 21:10:06.729220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.728955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.729429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.729401    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.729935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.729783    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.729935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.729883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lv5gd\""
Sep 15 21:10:06.730919 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.730904    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-klvt7\""
Sep 15 21:10:06.731319 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.731305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.731445 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.731424    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.731930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.731911    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.732122 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.732251 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-systemd-units\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.732347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-system-cni-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.732347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cnibin\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.732347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-systemd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-log-socket\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-daemon-config\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-etc-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732510    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-bin\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-script-lib\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-kubelet-config\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxmhw\" (UniqueName: \"kubernetes.io/projected/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-kube-api-access-vxmhw\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-system-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-socket-dir-parent\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-multus\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-netns\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-cnibin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-cni-binary-copy\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732881    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-k8s-cni-cncf-io\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-netns\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-conf-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-kubelet\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.732998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.732988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-node-log\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-netd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-dbus\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-hostroot\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-multus-certs\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-etc-kubernetes\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjcz\" (UniqueName: \"kubernetes.io/projected/7e36f496-e96f-4db8-a927-ac2799d7054b-kube-api-access-vsjcz\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-bin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-kubelet\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-slash\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-ovn\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-config\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-env-overrides\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.733670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafd90f8-c441-4398-bd0a-adc44222e828-agent-certs\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafd90f8-c441-4398-bd0a-adc44222e828-konnectivity-ca\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-var-lib-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733634    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2v89c\""
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733666    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733671    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f875bfb6-30b2-4567-88ac-48db907524ad-ovn-node-metrics-cert\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjprm\" (UniqueName: \"kubernetes.io/projected/f875bfb6-30b2-4567-88ac-48db907524ad-kube-api-access-qjprm\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.733929    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 21:10:06.734444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.734125    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.736302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.736282    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 21:10:06.736394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.736306    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.736394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.736335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.736553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.736538    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sw57n\""
Sep 15 21:10:06.736600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.736587    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.736666 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.736646    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:06.738910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.738890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.741225 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.741209    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 21:10:06.741427 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.741404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:10:06.741627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.741606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qnnv5\""
Sep 15 21:10:06.741893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.741875    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 21:10:06.757587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.757526    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4znl"
Sep 15 21:10:06.771022 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.771003    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x4znl"
Sep 15 21:10:06.823571 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.823546    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 21:10:06.834050 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-netns\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.834165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-dbus\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.834165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-netns\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-etc-kubernetes\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-dbus\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjcz\" (UniqueName: \"kubernetes.io/projected/7e36f496-e96f-4db8-a927-ac2799d7054b-kube-api-access-vsjcz\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-run\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-tuned\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-tmp\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.834345    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-etc-kubernetes\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafd90f8-c441-4398-bd0a-adc44222e828-agent-certs\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-var-lib-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.834408    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:07.334386913 +0000 UTC m=+2.942083992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-var-lib-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f875bfb6-30b2-4567-88ac-48db907524ad-ovn-node-metrics-cert\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-systemd\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-var-lib-kubelet\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktmt\" (UniqueName: \"kubernetes.io/projected/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-kube-api-access-cktmt\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-systemd-units\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-host\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834582    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-system-cni-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834633    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-log-socket\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.834777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15611823-4696-46c5-8246-c704b187a69f-serviceca\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0109072d-3dde-4376-9f9f-0c8ef1a97e77-tmp-dir\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-systemd-units\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834841    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-system-cni-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-daemon-config\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834900    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-log-socket\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834894    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.834978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-etc-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-bin\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-etc-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-script-lib\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-bin\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-socket-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-kubelet-config\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-binary-copy\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxmhw\" (UniqueName: \"kubernetes.io/projected/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-kube-api-access-vxmhw\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5df86f76-b4bc-496a-a33c-26433949cb80-kubelet-config\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:06.835567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-system-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-multus\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfgxf\" (UniqueName: \"kubernetes.io/projected/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-kube-api-access-hfgxf\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-conf\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-cnibin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-cni-binary-copy\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-system-cni-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-k8s-cni-cncf-io\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-cnibin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-conf-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-kubelet\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-script-lib\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-node-log\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-netd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-sys-fs\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-hostroot\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.836373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-multus-certs\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-slash\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-ovn\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.835991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmflv\" (UniqueName: \"kubernetes.io/projected/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kube-api-access-cmflv\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15611823-4696-46c5-8246-c704b187a69f-host\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-modprobe-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-bin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-daemon-config\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836166    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-kubelet\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-config\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-env-overrides\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-bin\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836251    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjprm\" (UniqueName: \"kubernetes.io/projected/f875bfb6-30b2-4567-88ac-48db907524ad-kube-api-access-qjprm\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxwx\" (UniqueName: \"kubernetes.io/projected/0109072d-3dde-4376-9f9f-0c8ef1a97e77-kube-api-access-dlxwx\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafd90f8-c441-4398-bd0a-adc44222e828-konnectivity-ca\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.837237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-kubernetes\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836413    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-hostroot\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e36f496-e96f-4db8-a927-ac2799d7054b-cni-binary-copy\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-multus-certs\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-device-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-slash\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-cni-multus\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-var-lib-kubelet\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-host-run-k8s-cni-cncf-io\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836577    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-conf-dir\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-kubelet\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-node-log\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-ovnkube-config\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836873    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-ovn\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f875bfb6-30b2-4567-88ac-48db907524ad-env-overrides\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836920    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-cni-netd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.836980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-openvswitch\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rtp8\" (UniqueName: \"kubernetes.io/projected/96a7275c-3420-437d-b3f4-a221e011287d-kube-api-access-8rtp8\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837038    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysconfig\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-sys\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-lib-modules\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0109072d-3dde-4376-9f9f-0c8ef1a97e77-hosts-file\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837174    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cnibin\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-cnibin\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-systemd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96a7275c-3420-437d-b3f4-a221e011287d-iptables-alerter-script\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96a7275c-3420-437d-b3f4-a221e011287d-host-slash\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.838903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-run-systemd\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-registration-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafd90f8-c441-4398-bd0a-adc44222e828-konnectivity-ca\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-socket-dir-parent\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7e36f496-e96f-4db8-a927-ac2799d7054b-multus-socket-dir-parent\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-netns\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnw8p\" (UniqueName: \"kubernetes.io/projected/15611823-4696-46c5-8246-c704b187a69f-kube-api-access-qnw8p\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.837712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f875bfb6-30b2-4567-88ac-48db907524ad-host-run-netns\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.839761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.839624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafd90f8-c441-4398-bd0a-adc44222e828-agent-certs\") pod \"konnectivity-agent-5tp9j\" (UID: \"aafd90f8-c441-4398-bd0a-adc44222e828\") " pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:06.840218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.839854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f875bfb6-30b2-4567-88ac-48db907524ad-ovn-node-metrics-cert\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.842607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.842580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjcz\" (UniqueName: \"kubernetes.io/projected/7e36f496-e96f-4db8-a927-ac2799d7054b-kube-api-access-vsjcz\") pod \"multus-mftm6\" (UID: \"7e36f496-e96f-4db8-a927-ac2799d7054b\") " pod="openshift-multus/multus-mftm6"
Sep 15 21:10:06.843036 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.843016    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:06.843113 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.843044    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:06.843113 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.843057    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:06.843222 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.843122    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:07.343104595 +0000 UTC m=+2.950801669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:06.844573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.844548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxmhw\" (UniqueName: \"kubernetes.io/projected/3dfe18f9-63e1-4ea2-9d23-cf220486bdee-kube-api-access-vxmhw\") pod \"multus-additional-cni-plugins-57dd2\" (UID: \"3dfe18f9-63e1-4ea2-9d23-cf220486bdee\") " pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:06.844785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.844766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjprm\" (UniqueName: \"kubernetes.io/projected/f875bfb6-30b2-4567-88ac-48db907524ad-kube-api-access-qjprm\") pod \"ovnkube-node-s4ns5\" (UID: \"f875bfb6-30b2-4567-88ac-48db907524ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:06.892231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.892205    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 21:10:06.938332 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-run\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938373    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-tuned\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-tmp\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-systemd\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-var-lib-kubelet\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktmt\" (UniqueName: \"kubernetes.io/projected/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-kube-api-access-cktmt\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-host\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15611823-4696-46c5-8246-c704b187a69f-serviceca\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0109072d-3dde-4376-9f9f-0c8ef1a97e77-tmp-dir\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-socket-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938646    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfgxf\" (UniqueName: \"kubernetes.io/projected/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-kube-api-access-hfgxf\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-conf\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-sys-fs\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-systemd\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmflv\" (UniqueName: \"kubernetes.io/projected/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kube-api-access-cmflv\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15611823-4696-46c5-8246-c704b187a69f-host\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-modprobe-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-run\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxwx\" (UniqueName: \"kubernetes.io/projected/0109072d-3dde-4376-9f9f-0c8ef1a97e77-kube-api-access-dlxwx\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-kubernetes\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.938857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-device-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rtp8\" (UniqueName: \"kubernetes.io/projected/96a7275c-3420-437d-b3f4-a221e011287d-kube-api-access-8rtp8\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysconfig\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-sys\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938935    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-lib-modules\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.938974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0109072d-3dde-4376-9f9f-0c8ef1a97e77-hosts-file\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.939002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96a7275c-3420-437d-b3f4-a221e011287d-iptables-alerter-script\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.939022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96a7275c-3420-437d-b3f4-a221e011287d-host-slash\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.939045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-registration-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.939085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnw8p\" (UniqueName: \"kubernetes.io/projected/15611823-4696-46c5-8246-c704b187a69f-kube-api-access-qnw8p\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.939471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.939107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.940286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-var-lib-kubelet\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.940384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-socket-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.940411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/15611823-4696-46c5-8246-c704b187a69f-serviceca\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.940441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-host\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-kubernetes\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0109072d-3dde-4376-9f9f-0c8ef1a97e77-tmp-dir\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/15611823-4696-46c5-8246-c704b187a69f-host\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-lib-modules\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysconfig\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96a7275c-3420-437d-b3f4-a221e011287d-host-slash\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-sys\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-device-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-registration-dir\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-modprobe-d\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.942972 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.941519    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:06.941579    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:07.441558204 +0000 UTC m=+3.049255270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-sys-fs\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-sysctl-conf\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.941665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0109072d-3dde-4376-9f9f-0c8ef1a97e77-hosts-file\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.942656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/96a7275c-3420-437d-b3f4-a221e011287d-iptables-alerter-script\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.943804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.943632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-etc-tuned\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.948197 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.947793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-tmp\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.950330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.950308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnw8p\" (UniqueName: \"kubernetes.io/projected/15611823-4696-46c5-8246-c704b187a69f-kube-api-access-qnw8p\") pod \"node-ca-qjpnf\" (UID: \"15611823-4696-46c5-8246-c704b187a69f\") " pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:06.950702 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.950674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rtp8\" (UniqueName: \"kubernetes.io/projected/96a7275c-3420-437d-b3f4-a221e011287d-kube-api-access-8rtp8\") pod \"iptables-alerter-zsj8z\" (UID: \"96a7275c-3420-437d-b3f4-a221e011287d\") " pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:06.950849 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.950825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktmt\" (UniqueName: \"kubernetes.io/projected/ff814a8d-e72c-4872-b9f6-2248ffa2b9fe-kube-api-access-cktmt\") pod \"tuned-6pmsg\" (UID: \"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe\") " pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:06.951282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.951258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfgxf\" (UniqueName: \"kubernetes.io/projected/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-kube-api-access-hfgxf\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:06.952493 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.952466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxwx\" (UniqueName: \"kubernetes.io/projected/0109072d-3dde-4376-9f9f-0c8ef1a97e77-kube-api-access-dlxwx\") pod \"node-resolver-d9d6m\" (UID: \"0109072d-3dde-4376-9f9f-0c8ef1a97e77\") " pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:06.953281 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.953259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmflv\" (UniqueName: \"kubernetes.io/projected/c47ae5dc-1de6-440b-a2f0-5bb1969b517d-kube-api-access-cmflv\") pod \"aws-ebs-csi-driver-node-j8m67\" (UID: \"c47ae5dc-1de6-440b-a2f0-5bb1969b517d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:06.961032 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.960964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal" event={"ID":"a1d1f32183c689b14f278b7c0504a490","Type":"ContainerStarted","Data":"3458b165bb591251c8609ecb00728f6e3f708bc4b9501b1b3095ea1de7020868"}
Sep 15 21:10:06.962428 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:06.962405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal" event={"ID":"f2754d12e45f210ea1afde936560260d","Type":"ContainerStarted","Data":"fe8e4b52d2e38ca86a181bc35277d69da9cad9f95c491104c95f8ef8b1bd6e06"}
Sep 15 21:10:07.027989 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.027961    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:07.037018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.036997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-57dd2"
Sep 15 21:10:07.047040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.047024    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mftm6"
Sep 15 21:10:07.053730 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.053712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:07.061604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.061579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6pmsg"
Sep 15 21:10:07.068488 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.068467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d9d6m"
Sep 15 21:10:07.077118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.077098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67"
Sep 15 21:10:07.085912 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.085894    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qjpnf"
Sep 15 21:10:07.092561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.092543    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zsj8z"
Sep 15 21:10:07.343368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.343272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:07.343368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.343309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343408    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343445    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343462    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:08.343447669 +0000 UTC m=+3.951144739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343465    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343475    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:07.343604 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.343514    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:08.34350277 +0000 UTC m=+3.951199836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:07.444315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.444282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:07.444466 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.444407    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:07.444466 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.444460    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:08.444447416 +0000 UTC m=+4.052144482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:07.774516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.774412    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:05:06 +0000 UTC" deadline="2028-06-18 09:12:36.286653746 +0000 UTC"
Sep 15 21:10:07.774516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.774460    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15396h2m28.512196736s"
Sep 15 21:10:07.956384 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:07.956343    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:07.956530 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:07.956459    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:08.017700 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.017674    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0109072d_3dde_4376_9f9f_0c8ef1a97e77.slice/crio-f4409b09de93e8cf15808a4356382c9f2176d5d29893c17cc9573d7189a3c4f3 WatchSource:0}: Error finding container f4409b09de93e8cf15808a4356382c9f2176d5d29893c17cc9573d7189a3c4f3: Status 404 returned error can't find the container with id f4409b09de93e8cf15808a4356382c9f2176d5d29893c17cc9573d7189a3c4f3
Sep 15 21:10:08.018799 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.018745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafd90f8_c441_4398_bd0a_adc44222e828.slice/crio-b7c022ac889321fb874d6ab1beb5ab7420c052176d09c29c660d4590ae4d4771 WatchSource:0}: Error finding container b7c022ac889321fb874d6ab1beb5ab7420c052176d09c29c660d4590ae4d4771: Status 404 returned error can't find the container with id b7c022ac889321fb874d6ab1beb5ab7420c052176d09c29c660d4590ae4d4771
Sep 15 21:10:08.020763 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.020653    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e36f496_e96f_4db8_a927_ac2799d7054b.slice/crio-b53722ac5b8126f23f61dbb57e8546038645cbb1c0f0e8d2cf662fe2abf54dff WatchSource:0}: Error finding container b53722ac5b8126f23f61dbb57e8546038645cbb1c0f0e8d2cf662fe2abf54dff: Status 404 returned error can't find the container with id b53722ac5b8126f23f61dbb57e8546038645cbb1c0f0e8d2cf662fe2abf54dff
Sep 15 21:10:08.021594 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.021407    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff814a8d_e72c_4872_b9f6_2248ffa2b9fe.slice/crio-09bd84acf26223e0d81ad0eb3a3d0c4f8e5266f92495588aab664ade498ca306 WatchSource:0}: Error finding container 09bd84acf26223e0d81ad0eb3a3d0c4f8e5266f92495588aab664ade498ca306: Status 404 returned error can't find the container with id 09bd84acf26223e0d81ad0eb3a3d0c4f8e5266f92495588aab664ade498ca306
Sep 15 21:10:08.024866 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.024815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15611823_4696_46c5_8246_c704b187a69f.slice/crio-16f15ca9bd4f56e38035fbd0e974c3461a283afb6bde7e142f284b1508888b94 WatchSource:0}: Error finding container 16f15ca9bd4f56e38035fbd0e974c3461a283afb6bde7e142f284b1508888b94: Status 404 returned error can't find the container with id 16f15ca9bd4f56e38035fbd0e974c3461a283afb6bde7e142f284b1508888b94
Sep 15 21:10:08.026324 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.026305    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfe18f9_63e1_4ea2_9d23_cf220486bdee.slice/crio-2306f697b3a56be1c0e02ab26fb51ac0cc69d4453c6197c52f4e319e5a000b99 WatchSource:0}: Error finding container 2306f697b3a56be1c0e02ab26fb51ac0cc69d4453c6197c52f4e319e5a000b99: Status 404 returned error can't find the container with id 2306f697b3a56be1c0e02ab26fb51ac0cc69d4453c6197c52f4e319e5a000b99
Sep 15 21:10:08.026754 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.026722    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf875bfb6_30b2_4567_88ac_48db907524ad.slice/crio-53947cdc1d00dd8e2612dec0d246ce8b8db95e60f72dcb8261f4d3cf65723882 WatchSource:0}: Error finding container 53947cdc1d00dd8e2612dec0d246ce8b8db95e60f72dcb8261f4d3cf65723882: Status 404 returned error can't find the container with id 53947cdc1d00dd8e2612dec0d246ce8b8db95e60f72dcb8261f4d3cf65723882
Sep 15 21:10:08.027598 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.027574    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96a7275c_3420_437d_b3f4_a221e011287d.slice/crio-a1cdfa2daba1e946b2d5cb5f21e8f89387f6a6a9bf191f4f547ea05e7b5867b3 WatchSource:0}: Error finding container a1cdfa2daba1e946b2d5cb5f21e8f89387f6a6a9bf191f4f547ea05e7b5867b3: Status 404 returned error can't find the container with id a1cdfa2daba1e946b2d5cb5f21e8f89387f6a6a9bf191f4f547ea05e7b5867b3
Sep 15 21:10:08.029489 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:08.029371    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47ae5dc_1de6_440b_a2f0_5bb1969b517d.slice/crio-106ce55197ff303f48eac71ca1432a4f834a85821202d9c0cef17f2d8db0ba80 WatchSource:0}: Error finding container 106ce55197ff303f48eac71ca1432a4f834a85821202d9c0cef17f2d8db0ba80: Status 404 returned error can't find the container with id 106ce55197ff303f48eac71ca1432a4f834a85821202d9c0cef17f2d8db0ba80
Sep 15 21:10:08.349904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.349842    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:08.349904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.349874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.349997    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.350012    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.350031    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.350041    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.350044    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:10.35003064 +0000 UTC m=+5.957727706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:08.350110 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.350079    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:10.350067017 +0000 UTC m=+5.957764083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:08.450442 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.450417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:08.450575 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.450558    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:08.450624 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.450610    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:10.450597818 +0000 UTC m=+6.058294884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:08.775179 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.775088    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 21:05:06 +0000 UTC" deadline="2028-02-22 11:38:24.142514255 +0000 UTC"
Sep 15 21:10:08.775179 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.775129    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12590h28m15.367389427s"
Sep 15 21:10:08.957117 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.957076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:08.957284 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.957141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:08.957284 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.957249    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:08.967153 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:08.967115    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:08.982656 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.982607    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal" event={"ID":"a1d1f32183c689b14f278b7c0504a490","Type":"ContainerStarted","Data":"fe94b61df801027ed81aded53904b3c8b86f853ffcf117ffb56023a5665ba88c"}
Sep 15 21:10:08.986215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.986187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zsj8z" event={"ID":"96a7275c-3420-437d-b3f4-a221e011287d","Type":"ContainerStarted","Data":"a1cdfa2daba1e946b2d5cb5f21e8f89387f6a6a9bf191f4f547ea05e7b5867b3"}
Sep 15 21:10:08.992340 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.992313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"53947cdc1d00dd8e2612dec0d246ce8b8db95e60f72dcb8261f4d3cf65723882"}
Sep 15 21:10:08.994889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:08.994864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjpnf" event={"ID":"15611823-4696-46c5-8246-c704b187a69f","Type":"ContainerStarted","Data":"16f15ca9bd4f56e38035fbd0e974c3461a283afb6bde7e142f284b1508888b94"}
Sep 15 21:10:09.006785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.006759    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mftm6" event={"ID":"7e36f496-e96f-4db8-a927-ac2799d7054b","Type":"ContainerStarted","Data":"b53722ac5b8126f23f61dbb57e8546038645cbb1c0f0e8d2cf662fe2abf54dff"}
Sep 15 21:10:09.010959 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.010922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tp9j" event={"ID":"aafd90f8-c441-4398-bd0a-adc44222e828","Type":"ContainerStarted","Data":"b7c022ac889321fb874d6ab1beb5ab7420c052176d09c29c660d4590ae4d4771"}
Sep 15 21:10:09.019606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.019579    2558 generic.go:356] "Generic (PLEG): container finished" podID="f2754d12e45f210ea1afde936560260d" containerID="430d8b1ecb28a387525509c74b311da0f59a4c571dcbcef764c8330f080bce13" exitCode=0
Sep 15 21:10:09.019705 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.019657    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal" event={"ID":"f2754d12e45f210ea1afde936560260d","Type":"ContainerDied","Data":"430d8b1ecb28a387525509c74b311da0f59a4c571dcbcef764c8330f080bce13"}
Sep 15 21:10:09.027121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.027063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67" event={"ID":"c47ae5dc-1de6-440b-a2f0-5bb1969b517d","Type":"ContainerStarted","Data":"106ce55197ff303f48eac71ca1432a4f834a85821202d9c0cef17f2d8db0ba80"}
Sep 15 21:10:09.031193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.031167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerStarted","Data":"2306f697b3a56be1c0e02ab26fb51ac0cc69d4453c6197c52f4e319e5a000b99"}
Sep 15 21:10:09.038217 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.038169    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-47.ec2.internal" podStartSLOduration=3.038150297 podStartE2EDuration="3.038150297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:09.000092352 +0000 UTC m=+4.607789464" watchObservedRunningTime="2026-09-15 21:10:09.038150297 +0000 UTC m=+4.645847384"
Sep 15 21:10:09.046570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.046538    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6pmsg" event={"ID":"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe","Type":"ContainerStarted","Data":"09bd84acf26223e0d81ad0eb3a3d0c4f8e5266f92495588aab664ade498ca306"}
Sep 15 21:10:09.050277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.050234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d9d6m" event={"ID":"0109072d-3dde-4376-9f9f-0c8ef1a97e77","Type":"ContainerStarted","Data":"f4409b09de93e8cf15808a4356382c9f2176d5d29893c17cc9573d7189a3c4f3"}
Sep 15 21:10:09.956578 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:09.956471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:09.957177 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:09.956623    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:10.064331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.063993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal" event={"ID":"f2754d12e45f210ea1afde936560260d","Type":"ContainerStarted","Data":"80edb8b27034b13f59a8fbfcc551f9a126afb0176374eddb8b67e08f6358574a"}
Sep 15 21:10:10.367007 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.366909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:10.367007 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.366977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:10.367234 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367124    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:10.367234 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367185    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:14.367167078 +0000 UTC m=+9.974864148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:10.367617 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367596    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:10.367617 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367621    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:10.367767 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367634    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:10.367767 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.367678    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:14.367662716 +0000 UTC m=+9.975359789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:10.467975 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.467381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:10.467975 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.467581    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:10.467975 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.467643    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:14.467625387 +0000 UTC m=+10.075322459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:10.958546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.957056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:10.958546 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.957180    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:10.958546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:10.957480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:10.958546 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:10.957581    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:11.956331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:11.956298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:11.956496 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:11.956427    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:12.957588 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:12.957551    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:12.958005 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:12.957678    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:12.958005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:12.957551    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:12.958005 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:12.957778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:13.956676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:13.956641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:13.956851 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:13.956794    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:14.403473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:14.403520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403656    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403712    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:22.403695185 +0000 UTC m=+18.011392276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403840    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403858    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403870    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:14.404009 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.403907    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:22.403895803 +0000 UTC m=+18.011592873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:14.503851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:14.503820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:14.504115 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.503937    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:14.504115 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.504016    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:22.503990612 +0000 UTC m=+18.111687681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:14.958031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:14.957817    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:14.958190 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:14.957901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:14.958190 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.958114    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:14.958312 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:14.958206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:15.956396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:15.956355    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:15.956853 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:15.956521    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:16.956751 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:16.956568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:16.956751 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:16.956688    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:16.957229 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:16.956892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:16.957229 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:16.957013    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:17.956820 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:17.956793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:17.957166 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:17.956905    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:18.956805 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:18.956760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:18.957013 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:18.956819    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:18.957013 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:18.956909    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:18.957418 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:18.957043    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:19.956798 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:19.956760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:19.957006 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:19.956881    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:20.956435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:20.956399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:20.956883 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:20.956531    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:20.956883 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:20.956548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:20.956883 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:20.956667    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:21.956562 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:21.956524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:21.957134 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:21.956646    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:22.460600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:22.460566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:22.460778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:22.460609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:22.460778 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460741    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:22.460778 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460745    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:22.460778 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460774    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:22.460962 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460787    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:22.460962 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460795    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:38.460778286 +0000 UTC m=+34.068475352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:22.460962 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.460839    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:10:38.460823738 +0000 UTC m=+34.068520808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:22.561805 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:22.561775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:22.561973 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.561887    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:22.561973 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.561940    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:38.56192318 +0000 UTC m=+34.169620247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:22.956875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:22.956798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:22.957336 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:22.956918    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:22.957336 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.956941    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:22.957336 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:22.957040    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:23.956630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:23.956597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:23.956796 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:23.956733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:24.957341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:24.957308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:24.957722 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:24.957411    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:24.957722 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:24.957443    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:24.957722 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:24.957532    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:25.956465 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:25.956296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:25.956619 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:25.956556    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:26.095532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.095441    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="2d58cf87bd72b9f1fb5daef362bc1182e627dfad57957a0e7b1f44b898d527e1" exitCode=0
Sep 15 21:10:26.096324 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.095534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"2d58cf87bd72b9f1fb5daef362bc1182e627dfad57957a0e7b1f44b898d527e1"}
Sep 15 21:10:26.097888 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.097836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6pmsg" event={"ID":"ff814a8d-e72c-4872-b9f6-2248ffa2b9fe","Type":"ContainerStarted","Data":"6ef557156281955d529815b74f4828a2576196c392fd892505fb75e1ee39beef"}
Sep 15 21:10:26.099625 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.099572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d9d6m" event={"ID":"0109072d-3dde-4376-9f9f-0c8ef1a97e77","Type":"ContainerStarted","Data":"befebe1e170df74a1fde839e8103d154beae2bad1ff958c7413bdb4137548685"}
Sep 15 21:10:26.106351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106326    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"ab572efe2f9a5dc68ea1925202f2ff1d6269b495778b2d8a680cfd18a04c572f"}
Sep 15 21:10:26.106477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"ef7717eaa0a8a705b24ce58eea7d900b68da12cbe29217ee23dd0a1e7d3e2132"}
Sep 15 21:10:26.106594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"a4bbf15058c44bb7a51b6ecd2b16a7816cc13325c9750f241edfa5930b81ef49"}
Sep 15 21:10:26.106594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"41e373a2d82b4fb9eb7e157c72c01a1836d65b3d0c7e3b5ff3158389ab8e04ca"}
Sep 15 21:10:26.106691 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"01cccc12e9b1875786fa3668082be2decf8b312c029b9da55ca9bcaa3bac88a1"}
Sep 15 21:10:26.106691 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.106634    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"7cd9f907a6644164671c2e02589dcb2410a647837a60e6c6ed64ec20ed56bf3f"}
Sep 15 21:10:26.107813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.107771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qjpnf" event={"ID":"15611823-4696-46c5-8246-c704b187a69f","Type":"ContainerStarted","Data":"cb683328b637c09de9379738a231a9ddb39ba9e871994f01442ecc1282fa96e2"}
Sep 15 21:10:26.109240 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.109218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mftm6" event={"ID":"7e36f496-e96f-4db8-a927-ac2799d7054b","Type":"ContainerStarted","Data":"f4a1f0e2a36bf25bafd4b67e4673f23d8728881df286ab3f36f97912e4804ffe"}
Sep 15 21:10:26.110710 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.110688    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5tp9j" event={"ID":"aafd90f8-c441-4398-bd0a-adc44222e828","Type":"ContainerStarted","Data":"584f4cd0a6a397c21f5f9198692eddcf9b3e633b495198c46b9d1b4d4f4acff4"}
Sep 15 21:10:26.112221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.112203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67" event={"ID":"c47ae5dc-1de6-440b-a2f0-5bb1969b517d","Type":"ContainerStarted","Data":"3add6a51436e16eac70e8158934bb6bbd88fef17de40568743727429425376a2"}
Sep 15 21:10:26.115799 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.115758    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-47.ec2.internal" podStartSLOduration=20.115747135 podStartE2EDuration="20.115747135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:10.078901044 +0000 UTC m=+5.686598132" watchObservedRunningTime="2026-09-15 21:10:26.115747135 +0000 UTC m=+21.723444222"
Sep 15 21:10:26.135603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.135565    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6pmsg" podStartSLOduration=4.047974619 podStartE2EDuration="21.135550945s" totalImagesPullingTime="17.087576326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:26.135068651 +0000 UTC m=+21.742765737" watchObservedRunningTime="2026-09-15 21:10:26.135550945 +0000 UTC m=+21.743248033"
Sep 15 21:10:26.147822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.147777    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d9d6m" podStartSLOduration=4.058665393 podStartE2EDuration="21.147763206s" totalImagesPullingTime="17.089097813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:26.147416713 +0000 UTC m=+21.755113799" watchObservedRunningTime="2026-09-15 21:10:26.147763206 +0000 UTC m=+21.755460295"
Sep 15 21:10:26.161933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.161901    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qjpnf" podStartSLOduration=11.289246463 podStartE2EDuration="21.161889736s" totalImagesPullingTime="9.872643273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:26.161668971 +0000 UTC m=+21.769366055" watchObservedRunningTime="2026-09-15 21:10:26.161889736 +0000 UTC m=+21.769586823"
Sep 15 21:10:26.197313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.197276    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mftm6" podStartSLOduration=4.076171767 podStartE2EDuration="21.197265785s" totalImagesPullingTime="17.121094018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:26.197117222 +0000 UTC m=+21.804814309" watchObservedRunningTime="2026-09-15 21:10:26.197265785 +0000 UTC m=+21.804962854"
Sep 15 21:10:26.197689 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.197668    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5tp9j" podStartSLOduration=4.109074723 podStartE2EDuration="21.197663535s" totalImagesPullingTime="17.088588812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:26.179530636 +0000 UTC m=+21.787227735" watchObservedRunningTime="2026-09-15 21:10:26.197663535 +0000 UTC m=+21.805360622"
Sep 15 21:10:26.508410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.508273    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 21:10:26.937562 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.937476    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T21:10:26.508406305Z","UUID":"ac946cbc-194f-460e-a7f6-1e5c508df3d6","Handler":null,"Name":"","Endpoint":""}
Sep 15 21:10:26.938767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.938747    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 21:10:26.938899 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.938778    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 21:10:26.956647 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.956624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:26.956771 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:26.956628    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:26.956771 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:26.956746    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:26.956874 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:26.956813    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:27.117002 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:27.116967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67" event={"ID":"c47ae5dc-1de6-440b-a2f0-5bb1969b517d","Type":"ContainerStarted","Data":"040c6efce0ca3dafddf49d8cae73b44cad5d6d327bf89343a8728389d647de98"}
Sep 15 21:10:27.119034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:27.119005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zsj8z" event={"ID":"96a7275c-3420-437d-b3f4-a221e011287d","Type":"ContainerStarted","Data":"c3e9893ca63cff4f52ec6ef7bcdea6774f89f23ae3eab657df235c6622d131ee"}
Sep 15 21:10:27.144103 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:27.144048    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zsj8z" podStartSLOduration=5.06700448 podStartE2EDuration="22.144030697s" totalImagesPullingTime="17.077026217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:27.143614992 +0000 UTC m=+22.751312080" watchObservedRunningTime="2026-09-15 21:10:27.144030697 +0000 UTC m=+22.751727786"
Sep 15 21:10:27.956344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:27.956321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:27.956433 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:27.956417    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:28.124263 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.124226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67" event={"ID":"c47ae5dc-1de6-440b-a2f0-5bb1969b517d","Type":"ContainerStarted","Data":"9300ccdb952fc687a8c841f0ec9e4f085cef79f208aab14e020b881d14f27820"}
Sep 15 21:10:28.128051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.128020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"23f7cc054aa43b6f0b98a14a87a8863a362d1f8e235a27c0aaf60d57bc7ebc03"}
Sep 15 21:10:28.142537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.142456    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8m67" podStartSLOduration=3.95461257 podStartE2EDuration="23.142443813s" totalImagesPullingTime="19.187831243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:28.142404133 +0000 UTC m=+23.750101223" watchObservedRunningTime="2026-09-15 21:10:28.142443813 +0000 UTC m=+23.750140901"
Sep 15 21:10:28.237772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.237738    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:28.238323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.238301    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:28.956878 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.956852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:28.957104 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:28.956981    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:28.957104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.957045    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:28.957195 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:28.957151    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:28.987608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.987584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:28.988004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:28.987989    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5tp9j"
Sep 15 21:10:29.956773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:29.956743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:29.957316 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:29.956857    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:30.957609 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:30.956404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:30.958058 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:30.957778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:30.959483 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:30.958193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:30.959483 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:30.958790    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:31.137049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.136907    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerStarted","Data":"c0a2992b57a9fd7cd6fe39408f86b8244220997a78122e3afa499f3f93607d88"}
Sep 15 21:10:31.140703 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.140682    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" event={"ID":"f875bfb6-30b2-4567-88ac-48db907524ad","Type":"ContainerStarted","Data":"2e140d36adaef317820b644e13dc2df49fb9d5f286a514d73cd3632bf46b43c6"}
Sep 15 21:10:31.141082 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.141061    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:31.141157 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.141138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:31.141205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.141186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:31.156047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.156011    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:31.157134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.157112    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:10:31.166209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.166162    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5" podStartSLOduration=8.980793382 podStartE2EDuration="26.166148543s" totalImagesPullingTime="17.185355161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:31.165795254 +0000 UTC m=+26.773492345" watchObservedRunningTime="2026-09-15 21:10:31.166148543 +0000 UTC m=+26.773845631"
Sep 15 21:10:31.956564 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:31.956537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:31.956717 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:31.956642    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:32.143903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.143873    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="c0a2992b57a9fd7cd6fe39408f86b8244220997a78122e3afa499f3f93607d88" exitCode=0
Sep 15 21:10:32.144403 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.143959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"c0a2992b57a9fd7cd6fe39408f86b8244220997a78122e3afa499f3f93607d88"}
Sep 15 21:10:32.918455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.918411    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtvm5"]
Sep 15 21:10:32.918604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.918577    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:32.918688 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:32.918667    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:32.919076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.919056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v95z5"]
Sep 15 21:10:32.919166 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.919150    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:32.919243 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:32.919226    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:32.920437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.920415    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9675j"]
Sep 15 21:10:32.920525 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:32.920502    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:32.920588 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:32.920573    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:33.956397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:33.956370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:33.956883 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:33.956461    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:34.149447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:34.149413    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="513a58de5d20547fa86f197c20457ad87d81687a6a1ca747c4eb7edb72690071" exitCode=0
Sep 15 21:10:34.149578 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:34.149456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"513a58de5d20547fa86f197c20457ad87d81687a6a1ca747c4eb7edb72690071"}
Sep 15 21:10:34.958307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:34.958146    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:34.958723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:34.958227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:34.958723 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:34.958471    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:34.958723 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:34.958604    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:35.956192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:35.956160    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:35.956349 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:35.956266    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:36.156327 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:36.156292    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="f6ff9d0a17f9b99fa7db06a9b10505ac6af1548c859a782b4f91e6087bef7b99" exitCode=0
Sep 15 21:10:36.156719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:36.156337    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"f6ff9d0a17f9b99fa7db06a9b10505ac6af1548c859a782b4f91e6087bef7b99"}
Sep 15 21:10:36.956942 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:36.956914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:36.957167 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:36.957027    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtvm5" podUID="5df86f76-b4bc-496a-a33c-26433949cb80"
Sep 15 21:10:36.957167 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:36.957097    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:36.957307 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:36.957183    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:10:37.956848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:37.956757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:37.957357 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:37.956892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9675j" podUID="49f73043-d42a-419e-b896-01f53fe40d5a"
Sep 15 21:10:38.147889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.147862    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-47.ec2.internal" event="NodeReady"
Sep 15 21:10:38.148082 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.148014    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 21:10:38.189311 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.189276    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:10:38.207258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.207182    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:10:38.207394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.207319    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.209533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.209341    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dnxk5\""
Sep 15 21:10:38.209827 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.209763    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 21:10:38.209827 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.209832    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 21:10:38.210908 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.210887    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 21:10:38.215776 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.215613    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 21:10:38.216083 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.216065    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vbb4h"]
Sep 15 21:10:38.241170 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.241146    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"]
Sep 15 21:10:38.241317 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.241283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.244680 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.244651    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 21:10:38.244985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.244702    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 21:10:38.244985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.244664    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nfdpp\""
Sep 15 21:10:38.257207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.257184    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jxjxt"]
Sep 15 21:10:38.257315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.257300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.260083 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.260062    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 21:10:38.260202 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.260106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 21:10:38.260686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.260328    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 21:10:38.260686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.260537    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 21:10:38.260927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.260908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 21:10:38.261205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.261187    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 21:10:38.261534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.261360    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 21:10:38.279358 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.279337    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"]
Sep 15 21:10:38.279471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.279456    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.281416 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.281400    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 21:10:38.281869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.281850    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 21:10:38.281869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.281861    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 21:10:38.282030 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.281934    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lhn5\""
Sep 15 21:10:38.295411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.295391    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"]
Sep 15 21:10:38.295526 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.295512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.297832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.297815    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vtp5z\""
Sep 15 21:10:38.297924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.297814    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 21:10:38.317439 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbb4h"]
Sep 15 21:10:38.317524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317448    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"]
Sep 15 21:10:38.317524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"]
Sep 15 21:10:38.317524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"]
Sep 15 21:10:38.317524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jxjxt"]
Sep 15 21:10:38.317679 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.317534    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.319660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.319641    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 21:10:38.376377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55cjr\" (UniqueName: \"kubernetes.io/projected/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-kube-api-access-55cjr\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.376539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc4e334-fb47-4af3-a71d-e70c768b25b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvmz2\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-config-volume\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbwlk\" (UniqueName: \"kubernetes.io/projected/ed36e166-de20-4bf7-9566-aeae3264dca0-kube-api-access-zbwlk\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.376780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-tmp-dir\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-492mm\" (UniqueName: \"kubernetes.io/projected/0bc4e334-fb47-4af3-a71d-e70c768b25b9-kube-api-access-492mm\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36e166-de20-4bf7-9566-aeae3264dca0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-cert\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnj7\" (UniqueName: \"kubernetes.io/projected/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-kube-api-access-hlnj7\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.377152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.376970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477324    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-tmp-dir\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-492mm\" (UniqueName: \"kubernetes.io/projected/0bc4e334-fb47-4af3-a71d-e70c768b25b9-kube-api-access-492mm\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36e166-de20-4bf7-9566-aeae3264dca0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c59e2f31-a0b0-47f1-b808-6b182663659a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:38.477529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-cert\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnj7\" (UniqueName: \"kubernetes.io/projected/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-kube-api-access-hlnj7\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e2f31-a0b0-47f1-b808-6b182663659a-tmp\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477709    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-tmp-dir\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55t7\" (UniqueName: \"kubernetes.io/projected/c59e2f31-a0b0-47f1-b808-6b182663659a-kube-api-access-m55t7\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.477806    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:38.477860 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.477869    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret podName:5df86f76-b4bc-496a-a33c-26433949cb80 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:10.477852741 +0000 UTC m=+66.085549817 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret") pod "global-pull-secret-syncer-dtvm5" (UID: "5df86f76-b4bc-496a-a33c-26433949cb80") : object "kube-system"/"original-pull-secret" not registered
Sep 15 21:10:38.478521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.478450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.478718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.478784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36e166-de20-4bf7-9566-aeae3264dca0-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.479467    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479470    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.479486    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.479500    2558 projected.go:196] Error preparing data for projected volume kube-api-access-978cr for pod openshift-network-diagnostics/network-check-target-9675j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.477808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55cjr\" (UniqueName: \"kubernetes.io/projected/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-kube-api-access-55cjr\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc4e334-fb47-4af3-a71d-e70c768b25b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.479546    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr podName:49f73043-d42a-419e-b896-01f53fe40d5a nodeName:}" failed. No retries permitted until 2026-09-15 21:11:10.479531091 +0000 UTC m=+66.087228166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-978cr" (UniqueName: "kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr") pod "network-check-target-9675j" (UID: "49f73043-d42a-419e-b896-01f53fe40d5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvmz2\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-config-volume\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.479811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.479759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbwlk\" (UniqueName: \"kubernetes.io/projected/ed36e166-de20-4bf7-9566-aeae3264dca0-kube-api-access-zbwlk\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.480616 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.480067    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:38.480616 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.480083    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:38.480616 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.480126    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:38.980110971 +0000 UTC m=+34.587808057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:10:38.480616 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.480354    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:38.480616 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.480395    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:10:38.980381895 +0000 UTC m=+34.588078979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:38.480848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.480735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-config-volume\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.482757 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.482617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-cert\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.482862 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.482664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.483047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.483026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-ca\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.483389 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.483367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.483572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.483539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.483871 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.483836    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc4e334-fb47-4af3-a71d-e70c768b25b9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.484149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.484124    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.484699 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.484678    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed36e166-de20-4bf7-9566-aeae3264dca0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.488284 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.488263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-492mm\" (UniqueName: \"kubernetes.io/projected/0bc4e334-fb47-4af3-a71d-e70c768b25b9-kube-api-access-492mm\") pod \"managed-serviceaccount-addon-agent-74bf86bffd-lzk77\" (UID: \"0bc4e334-fb47-4af3-a71d-e70c768b25b9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.488431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.488412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnj7\" (UniqueName: \"kubernetes.io/projected/c439c286-dc5b-4cca-b7ef-f89e9a30c53b-kube-api-access-hlnj7\") pod \"ingress-canary-jxjxt\" (UID: \"c439c286-dc5b-4cca-b7ef-f89e9a30c53b\") " pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.488802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.488782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55cjr\" (UniqueName: \"kubernetes.io/projected/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-kube-api-access-55cjr\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.489010 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.488992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbwlk\" (UniqueName: \"kubernetes.io/projected/ed36e166-de20-4bf7-9566-aeae3264dca0-kube-api-access-zbwlk\") pod \"cluster-proxy-proxy-agent-6948965d6b-pbgk7\" (UID: \"ed36e166-de20-4bf7-9566-aeae3264dca0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.490933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.490911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.491299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.491259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvmz2\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.491613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.491587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:38.575902 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.575869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:10:38.581115 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.581086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e2f31-a0b0-47f1-b808-6b182663659a-tmp\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.581257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.581142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55t7\" (UniqueName: \"kubernetes.io/projected/c59e2f31-a0b0-47f1-b808-6b182663659a-kube-api-access-m55t7\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.581257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.581198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:38.581359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.581260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c59e2f31-a0b0-47f1-b808-6b182663659a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.581359 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.581349    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:38.581456 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.581427    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:10.581406915 +0000 UTC m=+66.189103993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 21:10:38.581512 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.581496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e2f31-a0b0-47f1-b808-6b182663659a-tmp\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.583964 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.583925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c59e2f31-a0b0-47f1-b808-6b182663659a-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.587583 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.587541    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jxjxt"
Sep 15 21:10:38.591081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.591058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55t7\" (UniqueName: \"kubernetes.io/projected/c59e2f31-a0b0-47f1-b808-6b182663659a-kube-api-access-m55t7\") pod \"klusterlet-addon-workmgr-7fc5bf84c7-pxbls\" (UID: \"c59e2f31-a0b0-47f1-b808-6b182663659a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.603494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.603476    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"
Sep 15 21:10:38.604750 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.604727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:38.643184 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.643056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:38.892368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.892296    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"]
Sep 15 21:10:38.897536 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.897508    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jxjxt"]
Sep 15 21:10:38.898227 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:38.898201    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded36e166_de20_4bf7_9566_aeae3264dca0.slice/crio-3206ad866fec9a513395e94158aeac768d11c136ac7565e9b26c33558ef7f2c1 WatchSource:0}: Error finding container 3206ad866fec9a513395e94158aeac768d11c136ac7565e9b26c33558ef7f2c1: Status 404 returned error can't find the container with id 3206ad866fec9a513395e94158aeac768d11c136ac7565e9b26c33558ef7f2c1
Sep 15 21:10:38.900615 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:38.900584    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc439c286_dc5b_4cca_b7ef_f89e9a30c53b.slice/crio-abf412bfcd1def7cf0146769350d9cdfee33633cdc842fec6831fbf6d3882df5 WatchSource:0}: Error finding container abf412bfcd1def7cf0146769350d9cdfee33633cdc842fec6831fbf6d3882df5: Status 404 returned error can't find the container with id abf412bfcd1def7cf0146769350d9cdfee33633cdc842fec6831fbf6d3882df5
Sep 15 21:10:38.925143 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.925121    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77"]
Sep 15 21:10:38.928222 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:38.928194    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc4e334_fb47_4af3_a71d_e70c768b25b9.slice/crio-487b2101af6e88364d36710b8189f42bd26c32ce90062f3d637a5b910724c6c5 WatchSource:0}: Error finding container 487b2101af6e88364d36710b8189f42bd26c32ce90062f3d637a5b910724c6c5: Status 404 returned error can't find the container with id 487b2101af6e88364d36710b8189f42bd26c32ce90062f3d637a5b910724c6c5
Sep 15 21:10:38.941183 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.941159    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"]
Sep 15 21:10:38.944633 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:10:38.944616    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59e2f31_a0b0_47f1_b808_6b182663659a.slice/crio-0e9ce53acdd3ac690ab037903b0e775da532c8f214515bbf00ff3a2d6e3559aa WatchSource:0}: Error finding container 0e9ce53acdd3ac690ab037903b0e775da532c8f214515bbf00ff3a2d6e3559aa: Status 404 returned error can't find the container with id 0e9ce53acdd3ac690ab037903b0e775da532c8f214515bbf00ff3a2d6e3559aa
Sep 15 21:10:38.956813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.956790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:10:38.956897 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.956790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:10:38.959504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.959487    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 21:10:38.959602 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.959503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 21:10:38.959602 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.959521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8fnh6\""
Sep 15 21:10:38.985049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.985029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:38.985123 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:38.985071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:38.985181 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.985166    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:38.985215 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.985184    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:38.985246 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.985213    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:38.985246 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.985223    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:39.985208393 +0000 UTC m=+35.592905459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:10:38.985309 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:38.985270    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:10:39.9852597 +0000 UTC m=+35.592956766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:39.164274 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.164205    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls" event={"ID":"c59e2f31-a0b0-47f1-b808-6b182663659a","Type":"ContainerStarted","Data":"0e9ce53acdd3ac690ab037903b0e775da532c8f214515bbf00ff3a2d6e3559aa"}
Sep 15 21:10:39.165285 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.165260    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77" event={"ID":"0bc4e334-fb47-4af3-a71d-e70c768b25b9","Type":"ContainerStarted","Data":"487b2101af6e88364d36710b8189f42bd26c32ce90062f3d637a5b910724c6c5"}
Sep 15 21:10:39.166313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.166286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jxjxt" event={"ID":"c439c286-dc5b-4cca-b7ef-f89e9a30c53b","Type":"ContainerStarted","Data":"abf412bfcd1def7cf0146769350d9cdfee33633cdc842fec6831fbf6d3882df5"}
Sep 15 21:10:39.167456 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.167429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerStarted","Data":"3206ad866fec9a513395e94158aeac768d11c136ac7565e9b26c33558ef7f2c1"}
Sep 15 21:10:39.956414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.956380    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:10:39.959520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.959374    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 21:10:39.959520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.959429    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 21:10:39.960622 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.960392    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6cwlg\""
Sep 15 21:10:39.995811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.995774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:39.995967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:39.995855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:39.996038 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:39.996018    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:39.996099 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:39.996086    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:10:41.996067793 +0000 UTC m=+37.603764862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:39.996486 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:39.996468    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:39.996568 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:39.996489    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:39.996568 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:39.996528    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:41.996515288 +0000 UTC m=+37.604212361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:10:40.317490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:40.317423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:40.378264 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:40.378233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:42.016178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:42.016260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:42.016359    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:42.016374    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:42.016382    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:42.016451    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:10:46.016433859 +0000 UTC m=+41.624130932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:42.016497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:42.016471    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:46.016462062 +0000 UTC m=+41.624159131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:10:43.377992 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:43.377934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:46.043809 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:46.043765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:46.043839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:46.043912    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:46.043928    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:46.043934    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:46.043999    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:10:54.043983265 +0000 UTC m=+49.651680330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:10:46.044248 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:46.044017    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:10:54.04400864 +0000 UTC m=+49.651705712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:47.845261 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:47.845221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:47.944355 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:47.944317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:49.197967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.197920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jxjxt" event={"ID":"c439c286-dc5b-4cca-b7ef-f89e9a30c53b","Type":"ContainerStarted","Data":"92dfe3a4d7d5a9d51523ca14548c6b24036824e02b5e89688a34f67ad812b275"}
Sep 15 21:10:49.199426 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.199402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerStarted","Data":"27a65a74726eb3809ff3e54d58868f695904a70680fc131dc023c50895dbfdeb"}
Sep 15 21:10:49.202126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.202056    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="954dabe72d64f0db025ed63c3d6e1743e980f685483a5db275cc49d0139f2812" exitCode=0
Sep 15 21:10:49.202189 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.202131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"954dabe72d64f0db025ed63c3d6e1743e980f685483a5db275cc49d0139f2812"}
Sep 15 21:10:49.203638 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.203572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77" event={"ID":"0bc4e334-fb47-4af3-a71d-e70c768b25b9","Type":"ContainerStarted","Data":"4c6713d9db0a5ae4f5c443738f722519d4aeb8170fffd0006b132c4b194b63e2"}
Sep 15 21:10:49.220305 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.220260    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jxjxt" podStartSLOduration=1.389941834 podStartE2EDuration="11.220244764s" totalImagesPullingTime="9.83030293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:49.220213304 +0000 UTC m=+44.827910391" watchObservedRunningTime="2026-09-15 21:10:49.220244764 +0000 UTC m=+44.827941851"
Sep 15 21:10:49.270523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:49.270376    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77" podStartSLOduration=30.461794948 podStartE2EDuration="40.27035631s" totalImagesPullingTime="9.808561362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:49.269119587 +0000 UTC m=+44.876816676" watchObservedRunningTime="2026-09-15 21:10:49.27035631 +0000 UTC m=+44.878053400"
Sep 15 21:10:50.208807 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.208774    2558 generic.go:356] "Generic (PLEG): container finished" podID="3dfe18f9-63e1-4ea2-9d23-cf220486bdee" containerID="1ac022e25d515442b8a343763d9b7aec0a707c022be8379cb33017e3cef88423" exitCode=0
Sep 15 21:10:50.209210 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.208850    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerDied","Data":"1ac022e25d515442b8a343763d9b7aec0a707c022be8379cb33017e3cef88423"}
Sep 15 21:10:50.210400 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.210375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls" event={"ID":"c59e2f31-a0b0-47f1-b808-6b182663659a","Type":"ContainerStarted","Data":"247f21c6c918fc33b3d8f3ac22087710995bd122284424422c2fc7f8d702c584"}
Sep 15 21:10:50.210504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.210493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:50.212323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.212309    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:10:50.212542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.212524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerStarted","Data":"131b2a33fad67cc5309452d3a8e0a246ce242395589e8e984896858ab84b86ad"}
Sep 15 21:10:50.212607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.212555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerStarted","Data":"f74ff718c60bdeab28deb27f875c1491073cb85ace644ed79c78e78dbf5b83f7"}
Sep 15 21:10:50.246355 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.246307    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls" podStartSLOduration=30.989774118 podStartE2EDuration="41.246286987s" totalImagesPullingTime="10.256512869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:50.245225439 +0000 UTC m=+45.852922520" watchObservedRunningTime="2026-09-15 21:10:50.246286987 +0000 UTC m=+45.853984076"
Sep 15 21:10:50.265200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:50.265157    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" podStartSLOduration=32.434055264 podStartE2EDuration="42.265140326s" totalImagesPullingTime="9.831085062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:50.264035863 +0000 UTC m=+45.871732951" watchObservedRunningTime="2026-09-15 21:10:50.265140326 +0000 UTC m=+45.872837414"
Sep 15 21:10:51.218702 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:51.218669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57dd2" event={"ID":"3dfe18f9-63e1-4ea2-9d23-cf220486bdee","Type":"ContainerStarted","Data":"cb867792880a3e2c37f994072e5eab3d5e2b3aa87a5128465083062c083897b8"}
Sep 15 21:10:51.245082 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:51.245041    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-57dd2" podStartSLOduration=9.468367281999999 podStartE2EDuration="46.245026308s" totalImagesPullingTime="36.776659026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:10:51.243572415 +0000 UTC m=+46.851269503" watchObservedRunningTime="2026-09-15 21:10:51.245026308 +0000 UTC m=+46.852723429"
Sep 15 21:10:51.368606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:51.368582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:51.469135 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:51.469065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:52.878211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:52.878180    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:52.937802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:52.937775    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:53.850125 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:53.850094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:53.949434 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:53.949404    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:54.006743 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:54.006717    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:10:54.100169 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:54.100107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:10:54.100268 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:54.100248    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:10:54.100310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:10:54.100269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:10:54.100310 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:54.100304    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:11:10.100287063 +0000 UTC m=+65.707984144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:10:54.100476 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:54.100359    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:10:54.100476 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:54.100370    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:10:54.100476 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:10:54.100419    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:10.100408012 +0000 UTC m=+65.708105079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:11:03.164352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:03.164322    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s4ns5"
Sep 15 21:11:03.361766 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:03.361729    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:03.459684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:03.459645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:07.968662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:07.968587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:09.761774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:09.761732    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:09.835875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:09.835848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:09.893892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:09.893866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:10.119503 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.119397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:11:10.119503 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.119462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:11:10.119795 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.119556    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:11:10.119795 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.119567    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:11:10.119795 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.119588    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:11:10.119795 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.119628    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:11:42.119616004 +0000 UTC m=+97.727313070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:11:10.119795 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.119654    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:42.119637492 +0000 UTC m=+97.727334563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:11:10.389431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.389355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:10.450150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.450123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:10.522538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.522512    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:11:10.522648 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.522547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:11:10.524831 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.524817    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 21:11:10.524879 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.524848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 21:11:10.535564 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.535542    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 21:11:10.536113 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.536098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5df86f76-b4bc-496a-a33c-26433949cb80-original-pull-secret\") pod \"global-pull-secret-syncer-dtvm5\" (UID: \"5df86f76-b4bc-496a-a33c-26433949cb80\") " pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:11:10.546279 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.546259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978cr\" (UniqueName: \"kubernetes.io/projected/49f73043-d42a-419e-b896-01f53fe40d5a-kube-api-access-978cr\") pod \"network-check-target-9675j\" (UID: \"49f73043-d42a-419e-b896-01f53fe40d5a\") " pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:11:10.574015 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.573996    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6cwlg\""
Sep 15 21:11:10.582694 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.582680    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:11:10.623408 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.623378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:11:10.625664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.625644    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 21:11:10.634160 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.634140    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 21:11:10.634254 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:10.634219    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:14.634196207 +0000 UTC m=+130.241893278 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : secret "metrics-daemon-secret" not found
Sep 15 21:11:10.771221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.771190    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtvm5"
Sep 15 21:11:10.853537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:10.853509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9675j"]
Sep 15 21:11:10.856627 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:11:10.856599    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f73043_d42a_419e_b896_01f53fe40d5a.slice/crio-2655d7cf480c910e6aee5b5eafea2e4474006c6d1f6689b666594bf6a9a13255 WatchSource:0}: Error finding container 2655d7cf480c910e6aee5b5eafea2e4474006c6d1f6689b666594bf6a9a13255: Status 404 returned error can't find the container with id 2655d7cf480c910e6aee5b5eafea2e4474006c6d1f6689b666594bf6a9a13255
Sep 15 21:11:11.032924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:11.032856    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtvm5"]
Sep 15 21:11:11.035470 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:11:11.035446    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df86f76_b4bc_496a_a33c_26433949cb80.slice/crio-494f290eabcc483d9387804ce062b6416cf7c6cf115139472a70cbae17b220ba WatchSource:0}: Error finding container 494f290eabcc483d9387804ce062b6416cf7c6cf115139472a70cbae17b220ba: Status 404 returned error can't find the container with id 494f290eabcc483d9387804ce062b6416cf7c6cf115139472a70cbae17b220ba
Sep 15 21:11:11.276216 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:11.276188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtvm5" event={"ID":"5df86f76-b4bc-496a-a33c-26433949cb80","Type":"ContainerStarted","Data":"494f290eabcc483d9387804ce062b6416cf7c6cf115139472a70cbae17b220ba"}
Sep 15 21:11:11.277260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:11.277237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9675j" event={"ID":"49f73043-d42a-419e-b896-01f53fe40d5a","Type":"ContainerStarted","Data":"2655d7cf480c910e6aee5b5eafea2e4474006c6d1f6689b666594bf6a9a13255"}
Sep 15 21:11:13.092312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:13.092240    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:13.157386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:13.157350    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:16.296622 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:16.296586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9675j" event={"ID":"49f73043-d42a-419e-b896-01f53fe40d5a","Type":"ContainerStarted","Data":"20589b7e1566e5cc2eec9fc75ec52a6fcdc34b0dbb5b2c36fe113872bcf83b72"}
Sep 15 21:11:16.297091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:16.296649    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:11:16.298052 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:16.298013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtvm5" event={"ID":"5df86f76-b4bc-496a-a33c-26433949cb80","Type":"ContainerStarted","Data":"4a0b053c1bd73e79dc84425ffd5a671fec398f9e104345feb451094004f30e5a"}
Sep 15 21:11:16.312249 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:16.312199    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9675j" podStartSLOduration=68.208004696 podStartE2EDuration="1m11.312183695s" totalImagesPullingTime="3.104178999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:11:16.312145542 +0000 UTC m=+71.919842630" watchObservedRunningTime="2026-09-15 21:11:16.312183695 +0000 UTC m=+71.919880783"
Sep 15 21:11:16.327782 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:16.327743    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dtvm5" podStartSLOduration=67.0150635 podStartE2EDuration="1m11.327730144s" totalImagesPullingTime="4.312666644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:11:16.326876892 +0000 UTC m=+71.934573978" watchObservedRunningTime="2026-09-15 21:11:16.327730144 +0000 UTC m=+71.935427232"
Sep 15 21:11:30.937514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:30.937398    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:31.038695 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:31.038667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:42.142988 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:42.142939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:42.143005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:42.143072    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:42.143085    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:42.143090    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-775fccd657-cnpms: secret "image-registry-tls" not found
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:42.143137    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls podName:7dfa7d65-d90e-481a-bc89-434ae5fc0bad nodeName:}" failed. No retries permitted until 2026-09-15 21:12:46.14312321 +0000 UTC m=+161.750820277 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls") pod "dns-default-vbb4h" (UID: "7dfa7d65-d90e-481a-bc89-434ae5fc0bad") : secret "dns-default-metrics-tls" not found
Sep 15 21:11:42.143522 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:42.143150    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls podName:521a9004-c1e8-49f7-9e98-9e3502ba6db6 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:46.143144054 +0000 UTC m=+161.750841121 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls") pod "image-registry-775fccd657-cnpms" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6") : secret "image-registry-tls" not found
Sep 15 21:11:47.302990 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:47.302940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9675j"
Sep 15 21:11:47.381839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:47.381811    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:47.483801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:47.483766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:50.629053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.629009    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-479w8"]
Sep 15 21:11:50.631918 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.631900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.636573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.636545    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 21:11:50.636827 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.636809    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 21:11:50.636892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.636850    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 21:11:50.637604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.637585    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 21:11:50.637690 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.637616    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qznqd\""
Sep 15 21:11:50.649658 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.649639    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-479w8"]
Sep 15 21:11:50.652233 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.652209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:50.702127 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.702098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.702256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.702134    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87e4d64-3f46-4276-8d7d-9e01584a93e2-data-volume\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.702256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.702240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d87e4d64-3f46-4276-8d7d-9e01584a93e2-crio-socket\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.702351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.702273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.702351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.702321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k59zd\" (UniqueName: \"kubernetes.io/projected/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-api-access-k59zd\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.729063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.729036    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:11:50.802981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.802938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k59zd\" (UniqueName: \"kubernetes.io/projected/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-api-access-k59zd\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803098 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:50.803074    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:50.803098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87e4d64-3f46-4276-8d7d-9e01584a93e2-data-volume\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803287 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:50.803139    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:11:50.803287 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:50.803144    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:51.303124709 +0000 UTC m=+106.910821789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:50.803287 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:50.803215    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:51.303201342 +0000 UTC m=+106.910898412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : configmap "kube-rbac-proxy" not found
Sep 15 21:11:50.803287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d87e4d64-3f46-4276-8d7d-9e01584a93e2-crio-socket\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803488 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803317    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d87e4d64-3f46-4276-8d7d-9e01584a93e2-crio-socket\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.803488 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.803447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d87e4d64-3f46-4276-8d7d-9e01584a93e2-data-volume\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:50.812104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:50.812083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k59zd\" (UniqueName: \"kubernetes.io/projected/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-api-access-k59zd\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:51.307226 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:51.307187    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:51.307388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:51.307246    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:51.307388 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:51.307311    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:11:51.307388 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:51.307325    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:51.307388 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:51.307368    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:52.307354201 +0000 UTC m=+107.915051270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : configmap "kube-rbac-proxy" not found
Sep 15 21:11:51.307388 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:51.307380    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:52.307375154 +0000 UTC m=+107.915072220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:52.315309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:52.315268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:52.315670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:52.315344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:52.315670 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:52.315394    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:11:52.315670 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:52.315435    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:52.315670 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:52.315462    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:54.315441643 +0000 UTC m=+109.923138743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : configmap "kube-rbac-proxy" not found
Sep 15 21:11:52.315670 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:52.315477    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:54.31547015 +0000 UTC m=+109.923167219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:52.388435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:52.388408    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d9d6m_0109072d-3dde-4376-9f9f-0c8ef1a97e77/dns-node-resolver/0.log"
Sep 15 21:11:53.588582 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:53.588557    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjpnf_15611823-4696-46c5-8246-c704b187a69f/node-ca/0.log"
Sep 15 21:11:54.329486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:54.329449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:54.329655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:54.329528    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:54.329655 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:54.329627    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:54.329655 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:54.329649    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:11:54.329755 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:54.329693    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:58.329675914 +0000 UTC m=+113.937372980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:54.329755 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:54.329706    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:11:58.329700006 +0000 UTC m=+113.937397072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : configmap "kube-rbac-proxy" not found
Sep 15 21:11:54.588538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:54.588426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jxjxt_c439c286-dc5b-4cca-b7ef-f89e9a30c53b/serve-healthcheck-canary/0.log"
Sep 15 21:11:58.361066 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:58.361031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:58.361471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:11:58.361112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:11:58.361471 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:58.361147    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 21:11:58.361471 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:58.361220    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:06.361202975 +0000 UTC m=+121.968900041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : configmap "kube-rbac-proxy" not found
Sep 15 21:11:58.361471 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:58.361264    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:11:58.361471 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:11:58.361312    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:06.361300063 +0000 UTC m=+121.968997129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:01.057917 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:01.057884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:01.116328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:01.116301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:01.415220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:01.415143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:01.860424 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:01.860392    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:01.962704 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:01.962668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:02.055697 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:02.055664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:02.128756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:02.128668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:02.227023 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:02.226996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:03.768219 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:03.768193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:03.870248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:03.870223    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:03.968722 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:03.968691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:04.069630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:04.069581    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:05.711712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:05.711676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:06.416928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:06.416893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:06.417119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:06.416977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:06.417119 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:06.417086    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:06.417208 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:06.417139    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls podName:d87e4d64-3f46-4276-8d7d-9e01584a93e2 nodeName:}" failed. No retries permitted until 2026-09-15 21:12:22.417125865 +0000 UTC m=+138.024822931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-479w8" (UID: "d87e4d64-3f46-4276-8d7d-9e01584a93e2") : secret "insights-runtime-extractor-tls" not found
Sep 15 21:12:06.417477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:06.417457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d87e4d64-3f46-4276-8d7d-9e01584a93e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:07.719192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:07.719150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:07.919880 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:07.919845    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:08.018215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:08.018139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:08.078347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:08.078322    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:08.583519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:08.583494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:08.901998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:08.901929    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:09.235477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:09.235442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:09.446318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:09.446289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:09.843188 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:09.843164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:10.324176 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:10.324144    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:10.426645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:10.426622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:10.633205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:10.633132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:10.835723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:10.835693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:11.226078 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:11.226044    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:11.421676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:11.421644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:11.626670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:11.626592    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:12.189167 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:12.189126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:12.326415 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:12.326377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:12.818517 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:12.818482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:13.027136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:13.027104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:13.221336 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:13.221310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:13.322414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:13.322385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:13.873483 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:13.873444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:13.932558 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:13.932528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:14.684822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:14.684765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:12:14.685093 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:14.684924    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 21:12:14.685093 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:14.685066    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs podName:8a5ef3fc-3740-47d3-85ce-67e373dfdb37 nodeName:}" failed. No retries permitted until 2026-09-15 21:14:16.685023714 +0000 UTC m=+252.292720801 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs") pod "network-metrics-daemon-v95z5" (UID: "8a5ef3fc-3740-47d3-85ce-67e373dfdb37") : secret "metrics-daemon-secret" not found
Sep 15 21:12:14.820844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:14.820807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:15.027378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:15.027337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:15.222686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:15.222655    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:15.418065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:15.417989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:15.519849 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:15.519819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:15.620437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:15.620408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:16.816438 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:16.816401    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:17.707438 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:17.707406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:17.768914 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:17.768888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:18.226224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:18.226190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:18.421603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:18.421569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:21.520678 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:21.520648    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:21.682859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:21.682827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:21.780746 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:21.780667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:22.440671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:22.440635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:22.442894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:22.442863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d87e4d64-3f46-4276-8d7d-9e01584a93e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-479w8\" (UID: \"d87e4d64-3f46-4276-8d7d-9e01584a93e2\") " pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:22.742447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:22.742424    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qznqd\""
Sep 15 21:12:22.750990 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:22.750973    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-479w8"
Sep 15 21:12:23.034105 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:23.034072    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-479w8"]
Sep 15 21:12:23.486701 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:23.486674    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-479w8" event={"ID":"d87e4d64-3f46-4276-8d7d-9e01584a93e2","Type":"ContainerStarted","Data":"3cd006524b0af1518df085e6e84cb1d370b3c069ace2f5dd58da88e8bc7e52a8"}
Sep 15 21:12:23.486864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:23.486726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-479w8" event={"ID":"d87e4d64-3f46-4276-8d7d-9e01584a93e2","Type":"ContainerStarted","Data":"c2df74879a7fc84a7eafbed18d33822157e64a3cc565c5c71eb798d4fed0b943"}
Sep 15 21:12:24.492281 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:24.492242    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-479w8" event={"ID":"d87e4d64-3f46-4276-8d7d-9e01584a93e2","Type":"ContainerStarted","Data":"e063e240a241aaa2c89b4ed4464a5d9bcbf2c977c762322f717255e239d59c11"}
Sep 15 21:12:25.311351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:25.311326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:25.411844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:25.411817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:25.496841 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:25.496811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-479w8" event={"ID":"d87e4d64-3f46-4276-8d7d-9e01584a93e2","Type":"ContainerStarted","Data":"bcac26848891af6e738b5e3cf1cb83835287a992b8528754d4c0f2396d58fe99"}
Sep 15 21:12:25.514624 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:25.514581    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-479w8" podStartSLOduration=33.383782127 podStartE2EDuration="35.514567385s" totalImagesPullingTime="2.130785258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:11:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:25.51311368 +0000 UTC m=+141.120810768" watchObservedRunningTime="2026-09-15 21:12:25.514567385 +0000 UTC m=+141.122264485"
Sep 15 21:12:28.576403 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:28.576368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.648198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:28.648165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:28.751990 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:28.751959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.160858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:31.160826    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:31.261566 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:31.261529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.741553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:33.741523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.820295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:33.820264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:33.992722 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:33.992640    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:36.156377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:36.156342    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:37.933669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:37.933639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.146875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.146839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.226761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.226732    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vzrrk"]
Sep 15 21:12:38.230776 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.230759    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.233246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.233225    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 21:12:38.233246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.233256    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 21:12:38.233535 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.233520    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 21:12:38.233587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.233520    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 21:12:38.234040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.234017    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 21:12:38.234195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.234176    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s6wpq\""
Sep 15 21:12:38.234340 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.234317    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 21:12:38.270568 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.270537    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.352103 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-sys\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352103 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-textfile\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-metrics-client-ca\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-tls\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-accelerators-collector-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-wtmp\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352565 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnm6k\" (UniqueName: \"kubernetes.io/projected/0a695a19-e45a-405f-bd35-87bd9d8ca770-kube-api-access-wnm6k\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.352565 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.352392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-root\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.386534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.386499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.452923 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.452882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-tls\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.452923 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.452921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-accelerators-collector-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.452940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-wtmp\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnm6k\" (UniqueName: \"kubernetes.io/projected/0a695a19-e45a-405f-bd35-87bd9d8ca770-kube-api-access-wnm6k\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-root\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-sys\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-textfile\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-metrics-client-ca\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453255    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-wtmp\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453331    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-sys\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a695a19-e45a-405f-bd35-87bd9d8ca770-root\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453583 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-accelerators-collector-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-textfile\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.453828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.453809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a695a19-e45a-405f-bd35-87bd9d8ca770-metrics-client-ca\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.455245 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.455229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-tls\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.455333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.455297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a695a19-e45a-405f-bd35-87bd9d8ca770-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.463512 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.463491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnm6k\" (UniqueName: \"kubernetes.io/projected/0a695a19-e45a-405f-bd35-87bd9d8ca770-kube-api-access-wnm6k\") pod \"node-exporter-vzrrk\" (UID: \"0a695a19-e45a-405f-bd35-87bd9d8ca770\") " pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.488221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.488150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.540437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.540408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vzrrk"
Sep 15 21:12:38.552365 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:12:38.552337    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a695a19_e45a_405f_bd35_87bd9d8ca770.slice/crio-c94157627e6ac5e0c404d674f63c35376a2d66184a071a108bf149203ed41e9a WatchSource:0}: Error finding container c94157627e6ac5e0c404d674f63c35376a2d66184a071a108bf149203ed41e9a: Status 404 returned error can't find the container with id c94157627e6ac5e0c404d674f63c35376a2d66184a071a108bf149203ed41e9a
Sep 15 21:12:38.583486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.583459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.683902 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.683869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:38.786062 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:38.785984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:39.153740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:39.153665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:39.262015 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:39.261975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:39.488112 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:39.488081    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:39.543556 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:39.543517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vzrrk" event={"ID":"0a695a19-e45a-405f-bd35-87bd9d8ca770","Type":"ContainerStarted","Data":"c94157627e6ac5e0c404d674f63c35376a2d66184a071a108bf149203ed41e9a"}
Sep 15 21:12:40.547645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:40.547607    2558 generic.go:356] "Generic (PLEG): container finished" podID="0a695a19-e45a-405f-bd35-87bd9d8ca770" containerID="42616d12f5de89d16784350cf715ceb2680b319d4ac791034dd6484e8c173266" exitCode=0
Sep 15 21:12:40.548047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:40.547672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vzrrk" event={"ID":"0a695a19-e45a-405f-bd35-87bd9d8ca770","Type":"ContainerDied","Data":"42616d12f5de89d16784350cf715ceb2680b319d4ac791034dd6484e8c173266"}
Sep 15 21:12:41.141750 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.141714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:41.219638 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:41.219598    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-775fccd657-cnpms" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6"
Sep 15 21:12:41.240100 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.240067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:41.254202 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:41.254165    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vbb4h" podUID="7dfa7d65-d90e-481a-bc89-434ae5fc0bad"
Sep 15 21:12:41.347236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.347207    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:41.552581 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.552553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:12:41.552581 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.552573    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vzrrk" event={"ID":"0a695a19-e45a-405f-bd35-87bd9d8ca770","Type":"ContainerStarted","Data":"93b493b2890d1093e5322a7592f7782da3b5909debfa179024dcb28dfca43b1e"}
Sep 15 21:12:41.553074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.552621    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vzrrk" event={"ID":"0a695a19-e45a-405f-bd35-87bd9d8ca770","Type":"ContainerStarted","Data":"2ae7bd09482a60581ff41571e0d5b586977ed05e3f926c02354a5cee03143be8"}
Sep 15 21:12:41.572683 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.572632    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vzrrk" podStartSLOduration=2.472822175 podStartE2EDuration="3.572616403s" totalImagesPullingTime="1.039029624s" totalInitContainerRuntime="60.764604ms" isStatefulPod=true podCreationTimestamp="2026-09-15 21:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:41.571257344 +0000 UTC m=+157.178954447" watchObservedRunningTime="2026-09-15 21:12:41.572616403 +0000 UTC m=+157.180313491"
Sep 15 21:12:41.577200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:41.577179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:41.966652 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:12:41.966609    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v95z5" podUID="8a5ef3fc-3740-47d3-85ce-67e373dfdb37"
Sep 15 21:12:43.027836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:43.027803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:43.161637 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:43.161600    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:44.415826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:44.415796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:46.211024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.210984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:12:46.211382 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.211029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:12:46.213519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.213469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dfa7d65-d90e-481a-bc89-434ae5fc0bad-metrics-tls\") pod \"dns-default-vbb4h\" (UID: \"7dfa7d65-d90e-481a-bc89-434ae5fc0bad\") " pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:12:46.213622 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.213549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"image-registry-775fccd657-cnpms\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") " pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:12:46.354735 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.354707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:46.360193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.360175    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nfdpp\""
Sep 15 21:12:46.364307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.364294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:12:46.455067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.455038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:46.639198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:46.639108    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vbb4h"]
Sep 15 21:12:46.642788 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:12:46.642752    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfa7d65_d90e_481a_bc89_434ae5fc0bad.slice/crio-e0ad86ab11a710988232ae2fd1df2a95ba7c314fcf54b81e84cb7da69ed354de WatchSource:0}: Error finding container e0ad86ab11a710988232ae2fd1df2a95ba7c314fcf54b81e84cb7da69ed354de: Status 404 returned error can't find the container with id e0ad86ab11a710988232ae2fd1df2a95ba7c314fcf54b81e84cb7da69ed354de
Sep 15 21:12:47.571350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:47.571309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbb4h" event={"ID":"7dfa7d65-d90e-481a-bc89-434ae5fc0bad","Type":"ContainerStarted","Data":"e0ad86ab11a710988232ae2fd1df2a95ba7c314fcf54b81e84cb7da69ed354de"}
Sep 15 21:12:48.575571 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:48.575531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbb4h" event={"ID":"7dfa7d65-d90e-481a-bc89-434ae5fc0bad","Type":"ContainerStarted","Data":"e38a5db961a43329d1043014b2408c683df8136dd874227966d2fe18c5d2bb6c"}
Sep 15 21:12:48.576037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:48.575580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vbb4h" event={"ID":"7dfa7d65-d90e-481a-bc89-434ae5fc0bad","Type":"ContainerStarted","Data":"8865af246d0c1704b1ab7e4a994a8a07a4b9ee7fbe9db573c088fd6972af63d7"}
Sep 15 21:12:48.576037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:48.575611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:12:48.593028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:48.592967    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vbb4h" podStartSLOduration=129.122520113 podStartE2EDuration="2m10.592920682s" totalImagesPullingTime="1.470400569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:48.592374248 +0000 UTC m=+164.200071338" watchObservedRunningTime="2026-09-15 21:12:48.592920682 +0000 UTC m=+164.200617771"
Sep 15 21:12:49.580407 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.580372    2558 generic.go:356] "Generic (PLEG): container finished" podID="c59e2f31-a0b0-47f1-b808-6b182663659a" containerID="247f21c6c918fc33b3d8f3ac22087710995bd122284424422c2fc7f8d702c584" exitCode=1
Sep 15 21:12:49.580854 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.580453    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls" event={"ID":"c59e2f31-a0b0-47f1-b808-6b182663659a","Type":"ContainerDied","Data":"247f21c6c918fc33b3d8f3ac22087710995bd122284424422c2fc7f8d702c584"}
Sep 15 21:12:49.580854 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.580818    2558 scope.go:117] "RemoveContainer" containerID="247f21c6c918fc33b3d8f3ac22087710995bd122284424422c2fc7f8d702c584"
Sep 15 21:12:49.581973 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.581932    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc4e334-fb47-4af3-a71d-e70c768b25b9" containerID="4c6713d9db0a5ae4f5c443738f722519d4aeb8170fffd0006b132c4b194b63e2" exitCode=255
Sep 15 21:12:49.582085 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.581976    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77" event={"ID":"0bc4e334-fb47-4af3-a71d-e70c768b25b9","Type":"ContainerDied","Data":"4c6713d9db0a5ae4f5c443738f722519d4aeb8170fffd0006b132c4b194b63e2"}
Sep 15 21:12:49.582392 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:49.582375    2558 scope.go:117] "RemoveContainer" containerID="4c6713d9db0a5ae4f5c443738f722519d4aeb8170fffd0006b132c4b194b63e2"
Sep 15 21:12:50.211139 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:50.211106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:12:50.586960 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:50.586854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls" event={"ID":"c59e2f31-a0b0-47f1-b808-6b182663659a","Type":"ContainerStarted","Data":"2e0a4df43d38e38817d8d868dabaaf85a8c46c30925a9ed3a6c2b2555e074de7"}
Sep 15 21:12:50.587400 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:50.587075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:12:50.587724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:50.587702    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc5bf84c7-pxbls"
Sep 15 21:12:50.588608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:50.588586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74bf86bffd-lzk77" event={"ID":"0bc4e334-fb47-4af3-a71d-e70c768b25b9","Type":"ContainerStarted","Data":"2b9c091e38a5047beefa3102e9f0311dc65f5f2bf1a36532c328b192a34eac9c"}
Sep 15 21:12:51.161235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:51.161208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:51.260760 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:51.260727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:51.711515 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:51.711481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:51.987079 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:51.986992    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.052411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.052386    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.403307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.403225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.465615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.465586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.601777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.601745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.703548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.703468    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:52.803154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:52.803126    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.372724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:53.372693    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.583130 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:53.583097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.927540 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:53.927507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:53.957098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:53.957062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:12:54.795500 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:54.795472    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:54.853124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:54.853098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:12:55.956376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:55.956337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:12:55.958881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:55.958862    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dnxk5\""
Sep 15 21:12:55.967627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:55.967608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:12:56.243173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:56.243136    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:12:56.247276 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:12:56.247249    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521a9004_c1e8_49f7_9e98_9e3502ba6db6.slice/crio-161f9e4f30e99f7276aab2949fb7230945fce094779cf9381c632ef39338f10a WatchSource:0}: Error finding container 161f9e4f30e99f7276aab2949fb7230945fce094779cf9381c632ef39338f10a: Status 404 returned error can't find the container with id 161f9e4f30e99f7276aab2949fb7230945fce094779cf9381c632ef39338f10a
Sep 15 21:12:56.610578 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:56.610487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775fccd657-cnpms" event={"ID":"521a9004-c1e8-49f7-9e98-9e3502ba6db6","Type":"ContainerStarted","Data":"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"}
Sep 15 21:12:56.610578 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:56.610535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775fccd657-cnpms" event={"ID":"521a9004-c1e8-49f7-9e98-9e3502ba6db6","Type":"ContainerStarted","Data":"161f9e4f30e99f7276aab2949fb7230945fce094779cf9381c632ef39338f10a"}
Sep 15 21:12:56.610806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:56.610617    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:12:56.630333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:56.630277    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-775fccd657-cnpms" podStartSLOduration=171.630258728 podStartE2EDuration="2m51.630258728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:12:56.629252084 +0000 UTC m=+172.236949172" watchObservedRunningTime="2026-09-15 21:12:56.630258728 +0000 UTC m=+172.237955814"
Sep 15 21:12:58.584207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:12:58.584173    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vbb4h"
Sep 15 21:13:01.157421 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:01.157389    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:13:01.253930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:01.253899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:01.310137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:01.310092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.183020 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:02.182989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.284473 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:02.284442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:02.340814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:02.340761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:03.004669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:03.004637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:03.067176 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:03.067146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:07.727462 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:07.727430    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:07.828846 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:07.828813    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:07.891440 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:07.891413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:09.198806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:09.198772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:09.299687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:09.299652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:10.312929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:10.312901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:10.369444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:10.369413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:11.163038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:11.163006    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:13:14.817369 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:14.817334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:14.953156 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:14.953119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:15.397882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:15.397848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.236659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:16.236619    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.336981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:16.336936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.728120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:16.728091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:16.816339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:16.816309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:18.577867 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:18.577818    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" podUID="ed36e166-de20-4bf7-9566-aeae3264dca0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 21:13:19.006817 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:19.006789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:19.063295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:19.063267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:25.306501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:25.306469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:25.406968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:25.406918    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:26.174737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.174701    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-775fccd657-cnpms" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" containerName="registry" containerID="cri-o://ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad" gracePeriod=30
Sep 15 21:13:26.414917 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.414896    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:13:26.423468 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423442    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.423554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423476    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvmz2\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.423554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423501    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.423554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.423554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.424003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.423971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:13:26.424140 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.424110    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:13:26.425789 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.425730    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:26.425789 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.425732    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2" (OuterVolumeSpecName: "kube-api-access-qvmz2") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "kube-api-access-qvmz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:26.425895 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.425801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:13:26.523956 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.523929    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.524067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.523985    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.524067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524060    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets\") pod \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\" (UID: \"521a9004-c1e8-49f7-9e98-9e3502ba6db6\") "
Sep 15 21:13:26.524242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524225    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.524280 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524249    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvmz2\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-kube-api-access-qvmz2\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.524280 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524265    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-trusted-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.524280 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524279    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/521a9004-c1e8-49f7-9e98-9e3502ba6db6-bound-sa-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.524424 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.524290    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/521a9004-c1e8-49f7-9e98-9e3502ba6db6-registry-certificates\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.525991 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.525960    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:13:26.526078 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.526050    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:13:26.531203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.531182    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "521a9004-c1e8-49f7-9e98-9e3502ba6db6" (UID: "521a9004-c1e8-49f7-9e98-9e3502ba6db6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:13:26.625256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.625235    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-installation-pull-secrets\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.625256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.625254    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/521a9004-c1e8-49f7-9e98-9e3502ba6db6-image-registry-private-configuration\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.625370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.625263    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/521a9004-c1e8-49f7-9e98-9e3502ba6db6-ca-trust-extracted\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:13:26.710405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.710372    2558 generic.go:356] "Generic (PLEG): container finished" podID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" containerID="ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad" exitCode=0
Sep 15 21:13:26.710533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.710431    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-775fccd657-cnpms"
Sep 15 21:13:26.710533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.710464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775fccd657-cnpms" event={"ID":"521a9004-c1e8-49f7-9e98-9e3502ba6db6","Type":"ContainerDied","Data":"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"}
Sep 15 21:13:26.710608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.710535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-775fccd657-cnpms" event={"ID":"521a9004-c1e8-49f7-9e98-9e3502ba6db6","Type":"ContainerDied","Data":"161f9e4f30e99f7276aab2949fb7230945fce094779cf9381c632ef39338f10a"}
Sep 15 21:13:26.710608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.710556    2558 scope.go:117] "RemoveContainer" containerID="ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"
Sep 15 21:13:26.719180 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.719164    2558 scope.go:117] "RemoveContainer" containerID="ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"
Sep 15 21:13:26.719430 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:13:26.719411    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad\": container with ID starting with ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad not found: ID does not exist" containerID="ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"
Sep 15 21:13:26.719473 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.719438    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad"} err="failed to get container status \"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad\": rpc error: code = NotFound desc = could not find container \"ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad\": container with ID starting with ac5eeb1b73f7d1c107dac3e369e2cae4228f2a9f6df9810fee336d9ff8b5fcad not found: ID does not exist"
Sep 15 21:13:26.731249 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.731224    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:13:26.735550 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.735530    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-775fccd657-cnpms"]
Sep 15 21:13:26.960756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:26.960685    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" path="/var/lib/kubelet/pods/521a9004-c1e8-49f7-9e98-9e3502ba6db6/volumes"
Sep 15 21:13:28.122983 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:28.122933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:28.189426 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:28.189400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:28.577254 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:28.577222    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" podUID="ed36e166-de20-4bf7-9566-aeae3264dca0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 21:13:38.577495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.577453    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" podUID="ed36e166-de20-4bf7-9566-aeae3264dca0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 21:13:38.577881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.577532    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7"
Sep 15 21:13:38.578028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.578010    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"131b2a33fad67cc5309452d3a8e0a246ce242395589e8e984896858ab84b86ad"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 15 21:13:38.578074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.578051    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" podUID="ed36e166-de20-4bf7-9566-aeae3264dca0" containerName="service-proxy" containerID="cri-o://131b2a33fad67cc5309452d3a8e0a246ce242395589e8e984896858ab84b86ad" gracePeriod=30
Sep 15 21:13:38.751568 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.751539    2558 generic.go:356] "Generic (PLEG): container finished" podID="ed36e166-de20-4bf7-9566-aeae3264dca0" containerID="131b2a33fad67cc5309452d3a8e0a246ce242395589e8e984896858ab84b86ad" exitCode=2
Sep 15 21:13:38.751684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.751614    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerDied","Data":"131b2a33fad67cc5309452d3a8e0a246ce242395589e8e984896858ab84b86ad"}
Sep 15 21:13:38.751684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:38.751670    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6948965d6b-pbgk7" event={"ID":"ed36e166-de20-4bf7-9566-aeae3264dca0","Type":"ContainerStarted","Data":"ff5f9f9af9fdba728c8a9b89c47a473599a9ea04396a68f1c2638842f855cb57"}
Sep 15 21:13:40.314200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:40.314169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:40.370155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:40.370132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:43.452226 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:43.452187    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:43.510489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:43.510461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:54.280377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:54.280330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:13:54.341124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:13:54.341095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:08.483524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:08.483487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:08.544206 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:08.544179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:16.740453 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:16.740419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:14:16.742592 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:16.742571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5ef3fc-3740-47d3-85ce-67e373dfdb37-metrics-certs\") pod \"network-metrics-daemon-v95z5\" (UID: \"8a5ef3fc-3740-47d3-85ce-67e373dfdb37\") " pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:14:16.760166 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:16.760139    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8fnh6\""
Sep 15 21:14:16.768367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:16.768351    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v95z5"
Sep 15 21:14:17.038319 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:17.038255    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v95z5"]
Sep 15 21:14:17.041240 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:14:17.041213    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5ef3fc_3740_47d3_85ce_67e373dfdb37.slice/crio-c36fc1d539c5b2a6295f178b16023e1d7b6c99ada466bf5e36727786019128c9 WatchSource:0}: Error finding container c36fc1d539c5b2a6295f178b16023e1d7b6c99ada466bf5e36727786019128c9: Status 404 returned error can't find the container with id c36fc1d539c5b2a6295f178b16023e1d7b6c99ada466bf5e36727786019128c9
Sep 15 21:14:17.873195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:17.873163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v95z5" event={"ID":"8a5ef3fc-3740-47d3-85ce-67e373dfdb37","Type":"ContainerStarted","Data":"c36fc1d539c5b2a6295f178b16023e1d7b6c99ada466bf5e36727786019128c9"}
Sep 15 21:14:18.877516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:18.877482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v95z5" event={"ID":"8a5ef3fc-3740-47d3-85ce-67e373dfdb37","Type":"ContainerStarted","Data":"fe7db4d7c1b875b6a26b7bae8f00e4ec315589ad1444d520da0c178ec7489126"}
Sep 15 21:14:18.877867 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:18.877541    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v95z5" event={"ID":"8a5ef3fc-3740-47d3-85ce-67e373dfdb37","Type":"ContainerStarted","Data":"bc6cfbdbd5d553ea93f57f49a03d37f5098844ee736f89380ab4d3cfcc602e6a"}
Sep 15 21:14:18.893163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:18.893114    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v95z5" podStartSLOduration=252.606946428 podStartE2EDuration="4m13.893100209s" totalImagesPullingTime="1.286153781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:14:18.892516116 +0000 UTC m=+254.500213237" watchObservedRunningTime="2026-09-15 21:14:18.893100209 +0000 UTC m=+254.500797297"
Sep 15 21:14:18.992252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:18.992227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:19.097330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:19.097303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:25.319333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:25.319301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:25.422053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:25.422021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:41.023266 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:41.023176    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:41.080986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:41.080936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:51.804386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:51.804344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:51.905347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:51.905316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:52.119852 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:52.119759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:14:52.755617 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:14:52.755585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:04.745420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:04.745393    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 21:15:09.696197 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:09.696164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:17.100282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:17.100246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:17.202708 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:17.202679    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:33.463680 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:33.463645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:39.105704 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:39.105673    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:40.440098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:40.440062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:42.701700 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:42.701661    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:42.799230 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:42.799163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.222851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:44.222819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.331309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:44.331280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.781669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:44.781638    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:44.906639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:44.906604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:46.812683 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:46.812649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:47.222161 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:47.222130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:49.502094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:49.502059    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:49.603221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:49.603189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:55.439076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:55.439035    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:15:56.063040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.063008    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ztsks"]
Sep 15 21:15:56.063235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.063224    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" containerName="registry"
Sep 15 21:15:56.063281 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.063237    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" containerName="registry"
Sep 15 21:15:56.063281 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.063279    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="521a9004-c1e8-49f7-9e98-9e3502ba6db6" containerName="registry"
Sep 15 21:15:56.065719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.065704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.068042 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.068017    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 21:15:56.068042 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.068035    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 21:15:56.068576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.068563    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9fs9l\""
Sep 15 21:15:56.073749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.073732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsqb6\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-kube-api-access-dsqb6\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.073847 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.073768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-bound-sa-token\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.075958 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.075922    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ztsks"]
Sep 15 21:15:56.175317 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.175277    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsqb6\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-kube-api-access-dsqb6\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.175468 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.175362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-bound-sa-token\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.184587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.184559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-bound-sa-token\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.184758 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.184741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsqb6\" (UniqueName: \"kubernetes.io/projected/fae2154e-1af3-410d-9db6-2222895fb302-kube-api-access-dsqb6\") pod \"cert-manager-55b4d954d5-ztsks\" (UID: \"fae2154e-1af3-410d-9db6-2222895fb302\") " pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.374236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.374158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ztsks"
Sep 15 21:15:56.642248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.642066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ztsks"]
Sep 15 21:15:56.644863 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:15:56.644840    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfae2154e_1af3_410d_9db6_2222895fb302.slice/crio-63ddfefce3cd374bed22ffa9358b8464cd214aad2ab3c05dbc0ff4b7bd185cf8 WatchSource:0}: Error finding container 63ddfefce3cd374bed22ffa9358b8464cd214aad2ab3c05dbc0ff4b7bd185cf8: Status 404 returned error can't find the container with id 63ddfefce3cd374bed22ffa9358b8464cd214aad2ab3c05dbc0ff4b7bd185cf8
Sep 15 21:15:56.646634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:56.646617    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:15:57.172383 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:15:57.172353    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ztsks" event={"ID":"fae2154e-1af3-410d-9db6-2222895fb302","Type":"ContainerStarted","Data":"63ddfefce3cd374bed22ffa9358b8464cd214aad2ab3c05dbc0ff4b7bd185cf8"}
Sep 15 21:16:00.185624 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:00.185583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ztsks" event={"ID":"fae2154e-1af3-410d-9db6-2222895fb302","Type":"ContainerStarted","Data":"d75b1e2873863baaac323ed97fdd89edc1b89fc9f2299550a91073b2fd3a1f60"}
Sep 15 21:16:00.202212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:00.202165    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ztsks" podStartSLOduration=1.23065086 podStartE2EDuration="4.20214788s" totalImagesPullingTime="2.97149702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:15:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:00.201871087 +0000 UTC m=+355.809568177" watchObservedRunningTime="2026-09-15 21:16:00.20214788 +0000 UTC m=+355.809844970"
Sep 15 21:16:01.102248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:01.102214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:01.202703 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:01.202658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:02.712384 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:02.712343    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:06.731560 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:06.731526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:06.849198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:06.849166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:08.761018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:08.760983    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:16.908111 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:16.908064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:20.930936 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:20.930903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:22.816284 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:22.816250    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:22.948494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:22.948463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:23.442880 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.442854    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:23.717916 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.717873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:23.846836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.846810    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:23.855165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.855142    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"]
Sep 15 21:16:23.858406 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.858392    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:23.860858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.860839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 21:16:23.861167 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.861155    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 21:16:23.861460 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.861447    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 21:16:23.861671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.861657    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 21:16:23.861715 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.861657    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sp8bs\""
Sep 15 21:16:23.873283 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.873260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"]
Sep 15 21:16:23.954177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.954151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjpbp\" (UniqueName: \"kubernetes.io/projected/7a0b3878-dc1b-4dbf-808b-67e904d350ef-kube-api-access-sjpbp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:23.954310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.954190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:23.954310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.954212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:23.954310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.954295    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-tmp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:23.954490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:23.954343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-manifests\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.024552 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.024487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.055518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-manifests\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.055594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjpbp\" (UniqueName: \"kubernetes.io/projected/7a0b3878-dc1b-4dbf-808b-67e904d350ef-kube-api-access-sjpbp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.055594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055560    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.055594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.055745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055697    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-tmp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.055991 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.055943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-manifests\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.057845 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.057828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a0b3878-dc1b-4dbf-808b-67e904d350ef-tmp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.058081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.058065    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.058205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.058186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a0b3878-dc1b-4dbf-808b-67e904d350ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.065126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.065107    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjpbp\" (UniqueName: \"kubernetes.io/projected/7a0b3878-dc1b-4dbf-808b-67e904d350ef-kube-api-access-sjpbp\") pod \"opendatahub-operator-controller-manager-568b8bf8c4-c29rb\" (UID: \"7a0b3878-dc1b-4dbf-808b-67e904d350ef\") " pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.125690 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.125668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.168163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.168142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:24.229588 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.229545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.330207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.330133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.428298 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.428267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:24.441816 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:24.441792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"]
Sep 15 21:16:24.445686 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:16:24.445660    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0b3878_dc1b_4dbf_808b_67e904d350ef.slice/crio-de6ef62d8a3661b6ee2613dc89a9b054f6218267ef42cd355308a3a16012794e WatchSource:0}: Error finding container de6ef62d8a3661b6ee2613dc89a9b054f6218267ef42cd355308a3a16012794e: Status 404 returned error can't find the container with id de6ef62d8a3661b6ee2613dc89a9b054f6218267ef42cd355308a3a16012794e
Sep 15 21:16:25.267964 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:25.267916    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb" event={"ID":"7a0b3878-dc1b-4dbf-808b-67e904d350ef","Type":"ContainerStarted","Data":"de6ef62d8a3661b6ee2613dc89a9b054f6218267ef42cd355308a3a16012794e"}
Sep 15 21:16:28.281117 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:28.281079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb" event={"ID":"7a0b3878-dc1b-4dbf-808b-67e904d350ef","Type":"ContainerStarted","Data":"900aa77498f2fe8a7edce00d6138b02712a7c804a44e4a9f5c55a4f82037e2b9"}
Sep 15 21:16:29.285684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:29.285649    2558 generic.go:356] "Generic (PLEG): container finished" podID="7a0b3878-dc1b-4dbf-808b-67e904d350ef" containerID="900aa77498f2fe8a7edce00d6138b02712a7c804a44e4a9f5c55a4f82037e2b9" exitCode=0
Sep 15 21:16:29.286048 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:29.285692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb" event={"ID":"7a0b3878-dc1b-4dbf-808b-67e904d350ef","Type":"ContainerDied","Data":"900aa77498f2fe8a7edce00d6138b02712a7c804a44e4a9f5c55a4f82037e2b9"}
Sep 15 21:16:30.290631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:30.290598    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb" event={"ID":"7a0b3878-dc1b-4dbf-808b-67e904d350ef","Type":"ContainerStarted","Data":"0f44e70179f9fd8301d36dd6d74a0657ad6b2266b54349fa183e134e8f370261"}
Sep 15 21:16:30.291002 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:30.290711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:30.313905 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:30.313864    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb" podStartSLOduration=2.897263035 podStartE2EDuration="7.313849507s" totalImagesPullingTime="3.364437424s" totalInitContainerRuntime="1.052149048s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:30.312589646 +0000 UTC m=+385.920286746" watchObservedRunningTime="2026-09-15 21:16:30.313849507 +0000 UTC m=+385.921546596"
Sep 15 21:16:33.071100 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:33.071065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:33.173231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:33.173203    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:41.276718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.276679    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"]
Sep 15 21:16:41.283412 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.283391    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.286270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286234    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 21:16:41.286450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286239    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q2mw2\""
Sep 15 21:16:41.286450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286304    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 21:16:41.286450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286322    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 21:16:41.286450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 21:16:41.286450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.286289    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 21:16:41.288155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.288135    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"]
Sep 15 21:16:41.296126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.296106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-568b8bf8c4-c29rb"
Sep 15 21:16:41.375906 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.375876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.376088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.376004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1009d764-c541-4fa3-b3e0-db9e59595f79-manager-config\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.376088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.376074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmbs\" (UniqueName: \"kubernetes.io/projected/1009d764-c541-4fa3-b3e0-db9e59595f79-kube-api-access-jkmbs\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.376224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.376099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-metrics-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.476815 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.476781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1009d764-c541-4fa3-b3e0-db9e59595f79-manager-config\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.476815 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.476818    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmbs\" (UniqueName: \"kubernetes.io/projected/1009d764-c541-4fa3-b3e0-db9e59595f79-kube-api-access-jkmbs\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.477063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.476847    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-metrics-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.477063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.476880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.477519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.477493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1009d764-c541-4fa3-b3e0-db9e59595f79-manager-config\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.479240 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.479219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-metrics-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.479322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.479253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1009d764-c541-4fa3-b3e0-db9e59595f79-cert\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.486056 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.486030    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmbs\" (UniqueName: \"kubernetes.io/projected/1009d764-c541-4fa3-b3e0-db9e59595f79-kube-api-access-jkmbs\") pod \"lws-controller-manager-ffdbb6cbd-skmt7\" (UID: \"1009d764-c541-4fa3-b3e0-db9e59595f79\") " pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.593726 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.593641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:41.863565 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:41.863482    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"]
Sep 15 21:16:41.866345 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:16:41.866316    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1009d764_c541_4fa3_b3e0_db9e59595f79.slice/crio-8e757cd24b6c496e992fe1d4625263edaa20c64fd96e4b7f310a3a9d0f08014a WatchSource:0}: Error finding container 8e757cd24b6c496e992fe1d4625263edaa20c64fd96e4b7f310a3a9d0f08014a: Status 404 returned error can't find the container with id 8e757cd24b6c496e992fe1d4625263edaa20c64fd96e4b7f310a3a9d0f08014a
Sep 15 21:16:42.330680 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:42.330645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7" event={"ID":"1009d764-c541-4fa3-b3e0-db9e59595f79","Type":"ContainerStarted","Data":"8e757cd24b6c496e992fe1d4625263edaa20c64fd96e4b7f310a3a9d0f08014a"}
Sep 15 21:16:43.712231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:43.712196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:43.824127 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:43.824096    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:45.341477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:45.341440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7" event={"ID":"1009d764-c541-4fa3-b3e0-db9e59595f79","Type":"ContainerStarted","Data":"26f1cf6ccc15fc1a3508cbda26c75acc31ceb85273d1aff9afa1a865eddc21ed"}
Sep 15 21:16:45.341844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:45.341578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:45.358114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:45.358073    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7" podStartSLOduration=1.935916482 podStartE2EDuration="4.358058116s" totalImagesPullingTime="2.422141634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:16:45.357015664 +0000 UTC m=+400.964712753" watchObservedRunningTime="2026-09-15 21:16:45.358058116 +0000 UTC m=+400.965755205"
Sep 15 21:16:49.248568 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:49.248538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:49.417488 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:49.417452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:50.549172 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:50.549142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:50.650660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:50.650615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:51.463557 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:51.463507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:54.728425 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.728392    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hczd6"]
Sep 15 21:16:54.730633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.730618    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:54.732635 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.732613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 21:16:54.732757 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.732672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rmx6k\""
Sep 15 21:16:54.738767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.738745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hczd6"]
Sep 15 21:16:54.812122 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.812077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:54.872964 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.872926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpnml\" (UniqueName: \"kubernetes.io/projected/720a16e5-a08d-4145-9ba7-1248a436dd02-kube-api-access-gpnml\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:54.873120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.872996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:54.916212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.916183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:54.974268 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.974241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpnml\" (UniqueName: \"kubernetes.io/projected/720a16e5-a08d-4145-9ba7-1248a436dd02-kube-api-access-gpnml\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:54.974411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.974285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:54.974411 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:16:54.974381    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 15 21:16:54.974497 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:16:54.974440    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert podName:720a16e5-a08d-4145-9ba7-1248a436dd02 nodeName:}" failed. No retries permitted until 2026-09-15 21:16:55.474424881 +0000 UTC m=+411.082121949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert") pod "odh-model-controller-7998c67dc4-hczd6" (UID: "720a16e5-a08d-4145-9ba7-1248a436dd02") : secret "odh-model-controller-webhook-cert" not found
Sep 15 21:16:54.985198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:54.985151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpnml\" (UniqueName: \"kubernetes.io/projected/720a16e5-a08d-4145-9ba7-1248a436dd02-kube-api-access-gpnml\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:55.014194 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.014159    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:55.261727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.261641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:55.317659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.317632    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b4rbr"]
Sep 15 21:16:55.319551 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.319537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.321548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.321526    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 21:16:55.321668 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.321530    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-4kjgh\""
Sep 15 21:16:55.330055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.330033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b4rbr"]
Sep 15 21:16:55.377615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.377584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncdk7\" (UniqueName: \"kubernetes.io/projected/5992938c-72f2-4d79-a563-b617c5196bc3-kube-api-access-ncdk7\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.377615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.377617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5992938c-72f2-4d79-a563-b617c5196bc3-tls-certs\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.428894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.428863    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:55.478057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.478019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncdk7\" (UniqueName: \"kubernetes.io/projected/5992938c-72f2-4d79-a563-b617c5196bc3-kube-api-access-ncdk7\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.478057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.478056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5992938c-72f2-4d79-a563-b617c5196bc3-tls-certs\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.478273 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.478086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:55.480480 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.480448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5992938c-72f2-4d79-a563-b617c5196bc3-tls-certs\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.480613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.480555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/720a16e5-a08d-4145-9ba7-1248a436dd02-cert\") pod \"odh-model-controller-7998c67dc4-hczd6\" (UID: \"720a16e5-a08d-4145-9ba7-1248a436dd02\") " pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:55.486316 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.486294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncdk7\" (UniqueName: \"kubernetes.io/projected/5992938c-72f2-4d79-a563-b617c5196bc3-kube-api-access-ncdk7\") pod \"model-serving-api-54d89bd5fc-b4rbr\" (UID: \"5992938c-72f2-4d79-a563-b617c5196bc3\") " pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.491809 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.491789    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:55.630145 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.630053    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:16:55.640934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.640904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:16:55.902815 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.902727    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-b4rbr"]
Sep 15 21:16:55.907326 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:16:55.907302    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5992938c_72f2_4d79_a563_b617c5196bc3.slice/crio-ca3dae0016676e157fe1ba825ed055ecc005b6c5fab7e99768d2f748da25799c WatchSource:0}: Error finding container ca3dae0016676e157fe1ba825ed055ecc005b6c5fab7e99768d2f748da25799c: Status 404 returned error can't find the container with id ca3dae0016676e157fe1ba825ed055ecc005b6c5fab7e99768d2f748da25799c
Sep 15 21:16:55.914986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:55.914960    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hczd6"]
Sep 15 21:16:55.918387 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:16:55.918364    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720a16e5_a08d_4145_9ba7_1248a436dd02.slice/crio-6d0202d9af8ce26bae53f51e165d66a9282cd6586b892d8f8c0830dc047892aa WatchSource:0}: Error finding container 6d0202d9af8ce26bae53f51e165d66a9282cd6586b892d8f8c0830dc047892aa: Status 404 returned error can't find the container with id 6d0202d9af8ce26bae53f51e165d66a9282cd6586b892d8f8c0830dc047892aa
Sep 15 21:16:56.347929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.347900    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-ffdbb6cbd-skmt7"
Sep 15 21:16:56.379183 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.379149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr" event={"ID":"5992938c-72f2-4d79-a563-b617c5196bc3","Type":"ContainerStarted","Data":"ca3dae0016676e157fe1ba825ed055ecc005b6c5fab7e99768d2f748da25799c"}
Sep 15 21:16:56.380527 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.380501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6" event={"ID":"720a16e5-a08d-4145-9ba7-1248a436dd02","Type":"ContainerStarted","Data":"6d0202d9af8ce26bae53f51e165d66a9282cd6586b892d8f8c0830dc047892aa"}
Sep 15 21:16:56.396962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.396926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.499030 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.498995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.670233 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.670137    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:56.772768 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:56.772691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:16:57.143823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:16:57.143763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:00.398931 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.398891    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr" event={"ID":"5992938c-72f2-4d79-a563-b617c5196bc3","Type":"ContainerStarted","Data":"088b250bfb8e5ed76e2037e1350113019cba13ec19a9fe996ebe9a8df4f16fa3"}
Sep 15 21:17:00.399385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.399008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:17:00.400375 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.400352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6" event={"ID":"720a16e5-a08d-4145-9ba7-1248a436dd02","Type":"ContainerStarted","Data":"ef5b7f7a26ffb8fe5c140228b02a463bb09a6e699cb23a6dbff86ed1d9a36e8f"}
Sep 15 21:17:00.400495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.400483    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:17:00.427836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.427786    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr" podStartSLOduration=1.8008913949999998 podStartE2EDuration="5.427770954s" totalImagesPullingTime="3.626879559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:17:00.423890028 +0000 UTC m=+416.031587117" watchObservedRunningTime="2026-09-15 21:17:00.427770954 +0000 UTC m=+416.035468043"
Sep 15 21:17:00.450665 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:00.450616    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6" podStartSLOduration=2.8255812689999997 podStartE2EDuration="6.450596641s" totalImagesPullingTime="3.625015372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:17:00.449706361 +0000 UTC m=+416.057403472" watchObservedRunningTime="2026-09-15 21:17:00.450596641 +0000 UTC m=+416.058293730"
Sep 15 21:17:01.372575 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.372541    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"]
Sep 15 21:17:01.378693 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.378665    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.381094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381070    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 21:17:01.381218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381203    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 21:17:01.381290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381257    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 21:17:01.381366 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381349    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 21:17:01.381924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381907    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ddskr\""
Sep 15 21:17:01.382024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381908    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 21:17:01.382024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.381970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 21:17:01.389348 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.389327    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"]
Sep 15 21:17:01.525102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhhjd\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-kube-api-access-zhhjd\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525323    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.525591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.525422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.625985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.625875    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhhjd\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-kube-api-access-zhhjd\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.625985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.625924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.625985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.625973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.626265 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.626035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.626265 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.626071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.626265 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.626095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.626265 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.626134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.626934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.626908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.628522 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.628498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.628655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.628600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.628880 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.628863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.628925 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.628901    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.634684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.634661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.634958 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.634930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhhjd\" (UniqueName: \"kubernetes.io/projected/3b42a3e0-cb80-4dbb-bf0c-888855ad70be-kube-api-access-zhhjd\") pod \"istiod-openshift-gateway-5677ccb49b-tn5gc\" (UID: \"3b42a3e0-cb80-4dbb-bf0c-888855ad70be\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.687632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.687600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:01.960778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:01.960748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"]
Sep 15 21:17:01.963600 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:17:01.963573    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b42a3e0_cb80_4dbb_bf0c_888855ad70be.slice/crio-aa8132fe701f7e66bfa4ca613bbece8aae47e17e4d07e1c5a73082b282e85381 WatchSource:0}: Error finding container aa8132fe701f7e66bfa4ca613bbece8aae47e17e4d07e1c5a73082b282e85381: Status 404 returned error can't find the container with id aa8132fe701f7e66bfa4ca613bbece8aae47e17e4d07e1c5a73082b282e85381
Sep 15 21:17:02.410907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:02.410826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc" event={"ID":"3b42a3e0-cb80-4dbb-bf0c-888855ad70be","Type":"ContainerStarted","Data":"aa8132fe701f7e66bfa4ca613bbece8aae47e17e4d07e1c5a73082b282e85381"}
Sep 15 21:17:04.148061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:04.148000    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:05.111292 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.111253    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:17:05.111353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.111321    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:17:05.425162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.425074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc" event={"ID":"3b42a3e0-cb80-4dbb-bf0c-888855ad70be","Type":"ContainerStarted","Data":"ecfacf0efd058b68f22cd939b63e2dc00701efd89a1a5d1de9bf7c34e1d9f977"}
Sep 15 21:17:05.425162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.425151    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:05.450917 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.450869    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc" podStartSLOduration=1.305388227 podStartE2EDuration="4.450853908s" totalImagesPullingTime="3.145465681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:17:05.449225546 +0000 UTC m=+421.056922635" watchObservedRunningTime="2026-09-15 21:17:05.450853908 +0000 UTC m=+421.058550997"
Sep 15 21:17:05.710108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.710064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:05.837056 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:05.836989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:06.430503 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:06.430475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-tn5gc"
Sep 15 21:17:11.407169 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:11.407141    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hczd6"
Sep 15 21:17:11.409130 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:11.409101    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-b4rbr"
Sep 15 21:17:36.660795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:36.660711    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:36.713160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:36.713122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:55.741154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:55.741111    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:17:55.841398 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:17:55.841367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:03.466810 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:03.466739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:03.531745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:03.531707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:11.327747 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:11.327712    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:14.143007 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:14.142972    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:14.935617 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:14.935581    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.042337 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:15.042303    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.179335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:15.179298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.725328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:15.725299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:15.956589 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:15.956559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:16.131801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:16.131730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:16.231499 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:16.231467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:17.374693 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:17.374660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:18.614902 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:18.614870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:18.729745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:18.729719    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:19.322966 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:19.322902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:19.588084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:19.588003    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:19.751194 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:19.751150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:19.887290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:19.887212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:22.413835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:22.413805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:22.513057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:22.513030    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:24.143174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:24.143138    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:24.931381 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:24.931342    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:25.030602 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:25.030569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.728144 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:26.728110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:26.787430 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:26.787402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:29.417801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:29.417773    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:29.592633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:29.592597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:32.751751 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:32.751724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:32.851043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:32.851008    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:37.506883 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:37.506843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:37.598634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:37.598598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:37.673642 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:37.673587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:44.154659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:44.154625    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:44.264814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:44.264786    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:46.735674 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:46.735627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:46.801731 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:46.801695    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:51.702316 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:51.702281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:51.802331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:51.802295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:51.937999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:51.937968    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:52.009163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:52.009130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:56.957556 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:56.957478    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:57.060509 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:57.060483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:18:57.162762 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:18:57.162726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:12.327022 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:12.326985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:12.557476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:12.557439    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:23.725542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:23.725510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:23.831135 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:23.831102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:23.892297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:23.892271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:24.141022 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.140931    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:19:24.143054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.143031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.145239 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.145214    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 21:19:24.145368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.145334    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gg6k6\""
Sep 15 21:19:24.145431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.145387    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 21:19:24.146024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.146005    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 21:19:24.157439 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.157148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:19:24.181544 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.181514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:19:24.251927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.251896    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-config-file\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.252079 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.251962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvsb\" (UniqueName: \"kubernetes.io/projected/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-kube-api-access-qsvsb\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.352908 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.352881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-config-file\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.353055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.352919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvsb\" (UniqueName: \"kubernetes.io/projected/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-kube-api-access-qsvsb\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.353506 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.353486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-config-file\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.367269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.367248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvsb\" (UniqueName: \"kubernetes.io/projected/7a8b4fda-cd0d-4613-bbd1-faa982f907ef-kube-api-access-qsvsb\") pod \"limitador-limitador-84994f7ffc-fn4gv\" (UID: \"7a8b4fda-cd0d-4613-bbd1-faa982f907ef\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.453362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.453296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:24.607063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.607030    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:24.707707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.707688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:24.722585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.722558    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:19:24.725510 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:19:24.725484    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8b4fda_cd0d_4613_bbd1_faa982f907ef.slice/crio-09c79bf993f9fe0891d7b39196af29cd5811746cd528afeac111bee5ba8f5ff2 WatchSource:0}: Error finding container 09c79bf993f9fe0891d7b39196af29cd5811746cd528afeac111bee5ba8f5ff2: Status 404 returned error can't find the container with id 09c79bf993f9fe0891d7b39196af29cd5811746cd528afeac111bee5ba8f5ff2
Sep 15 21:19:24.939336 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:24.939302    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv" event={"ID":"7a8b4fda-cd0d-4613-bbd1-faa982f907ef","Type":"ContainerStarted","Data":"09c79bf993f9fe0891d7b39196af29cd5811746cd528afeac111bee5ba8f5ff2"}
Sep 15 21:19:26.949398 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:26.949365    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv" event={"ID":"7a8b4fda-cd0d-4613-bbd1-faa982f907ef","Type":"ContainerStarted","Data":"adfc88475c9861c8ddff2db567c74a6ce88e0e1ecf64c6932e567cafc2b056de"}
Sep 15 21:19:26.949798 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:26.949497    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:26.969210 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:26.969161    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv" podStartSLOduration=0.966909138 podStartE2EDuration="2.969141659s" totalImagesPullingTime="2.002232521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:19:26.968905163 +0000 UTC m=+562.576602263" watchObservedRunningTime="2026-09-15 21:19:26.969141659 +0000 UTC m=+562.576838750"
Sep 15 21:19:37.955075 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:37.955046    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"
Sep 15 21:19:41.356145 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:41.356112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:41.456447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:41.456419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:41.748855 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:41.748826    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:53.670728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:53.670696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:53.892080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:53.892039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:58.440631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:58.440597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:19:58.540007 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:19:58.539982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:00.784901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:00.784867    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:00.932938 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:00.932909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:01.006785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:01.006753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:04.732352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:04.732326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:04.900552 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:04.900520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:36.654254 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:36.654178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:36.754439 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:36.754410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.194182 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.194156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.284245 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.284218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.404435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.404406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.505137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.505106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.766646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.766576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.870360 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.870328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:38.929352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:38.929322    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:20:48.615474 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:48.615437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:48.712134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:48.712109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:20:55.546385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:20:55.546353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:06.166174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:06.166124    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:06.709185 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:06.709152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:21:20.339234 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:20.339196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:21.002740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:21.002711    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:21:29.545458 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:29.545427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:30.604558 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:30.604529    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:21:58.817185 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:58.817114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:21:59.546367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:21:59.546332    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:22:15.602270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.602238    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"]
Sep 15 21:22:15.605123 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.605106    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.607620 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.607602    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 21:22:15.608259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.608241    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 15 21:22:15.608259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.608250    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 21:22:15.608657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.608639    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mjjfq\""
Sep 15 21:22:15.616317 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.616298    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"]
Sep 15 21:22:15.684346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8d2b31-376f-40f3-81b1-e76007081eef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.684463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.684463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.684463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r9rg\" (UniqueName: \"kubernetes.io/projected/9a8d2b31-376f-40f3-81b1-e76007081eef-kube-api-access-2r9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.684576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.684576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.684481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.706630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.706603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:15.784864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.784841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r9rg\" (UniqueName: \"kubernetes.io/projected/9a8d2b31-376f-40f3-81b1-e76007081eef-kube-api-access-2r9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8d2b31-376f-40f3-81b1-e76007081eef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785383 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.785648 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.785595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.787270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.787241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a8d2b31-376f-40f3-81b1-e76007081eef-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.787616 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.787600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a8d2b31-376f-40f3-81b1-e76007081eef-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.796238 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.796219    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r9rg\" (UniqueName: \"kubernetes.io/projected/9a8d2b31-376f-40f3-81b1-e76007081eef-kube-api-access-2r9rg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s\" (UID: \"9a8d2b31-376f-40f3-81b1-e76007081eef\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:15.915334 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:15.915286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:16.183892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:16.183818    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"]
Sep 15 21:22:16.186696 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:22:16.186669    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8d2b31_376f_40f3_81b1_e76007081eef.slice/crio-e3cb6c606d1f51881e1344e7e159d587234add1ae8b3b41404f9a033ff9650ca WatchSource:0}: Error finding container e3cb6c606d1f51881e1344e7e159d587234add1ae8b3b41404f9a033ff9650ca: Status 404 returned error can't find the container with id e3cb6c606d1f51881e1344e7e159d587234add1ae8b3b41404f9a033ff9650ca
Sep 15 21:22:16.187828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:16.187811    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:22:16.516005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:16.515967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s" event={"ID":"9a8d2b31-376f-40f3-81b1-e76007081eef","Type":"ContainerStarted","Data":"e3cb6c606d1f51881e1344e7e159d587234add1ae8b3b41404f9a033ff9650ca"}
Sep 15 21:22:17.111455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:17.111423    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:22:17.521172 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:17.521138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s" event={"ID":"9a8d2b31-376f-40f3-81b1-e76007081eef","Type":"ContainerStarted","Data":"50441f0af652c14d8f8a9a4686bcf770a994f402b9548a98a25f5469f75ef446"}
Sep 15 21:22:17.539155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:17.539111    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s" podStartSLOduration=1.593222575 podStartE2EDuration="2.53909528s" totalImagesPullingTime="945.872705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:22:17.538072528 +0000 UTC m=+733.145769617" watchObservedRunningTime="2026-09-15 21:22:17.53909528 +0000 UTC m=+733.146792404"
Sep 15 21:22:17.742190 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:17.742158    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:20.155744 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:20.155706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:22.010029 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:22.009993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:22:25.915826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:25.915787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:25.916243 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:25.915865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:25.928232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:25.928198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:26.568149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:26.568116    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s"
Sep 15 21:22:26.844520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:26.844423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:26.897870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:26.897816    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:28.238192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:28.238163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:30.613476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:30.613445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:22:30.620633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:30.620571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:36.339679 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:36.339636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:22:36.439814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:22:36.439780    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:06.574847 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:06.574806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:06.678968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:06.678916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:35.211276 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:35.211196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:35.314772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:35.314743    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:36.337817 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:36.337784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:36.454086 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:36.454058    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.125266 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.125232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.234367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.234337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.330203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.330174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.498269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.498238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.609864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.609833    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.775100 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.775025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:52.847136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:52.847104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:53.571540 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:53.571510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:53.680661 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:53.680630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:53.786857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:53.786820    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:54.065921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:54.065895    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:54.140478 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:54.140446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.294927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:55.294893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.389170 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:55.389140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:55.453135 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:55.453103    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.289820 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.289776    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.350551 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.350526    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:23:56.402450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.402423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:56.928593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.928553    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:23:56.932318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.932296    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:56.934502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.934478    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 21:23:56.935380 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.935355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4hmqz\""
Sep 15 21:23:56.935518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.935382    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 21:23:56.935518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.935417    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-6f66f7-serving-cert\""
Sep 15 21:23:56.935518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.935383    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:23:56.943786 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.943762    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:23:56.973919 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:56.973899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.076764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.076738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwcth\" (UniqueName: \"kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.076890 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.076784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.076890 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.076810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.076890 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.076875    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.079057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.079036    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.177843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.177825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwcth\" (UniqueName: \"kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.177972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.177860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.177972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.177876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.177972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.177901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.178485 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.178468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.180302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.180257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.180302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.180289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.183392 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.183372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.185819 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.185791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwcth\" (UniqueName: \"kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth\") pod \"maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.243554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.243531    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:57.514053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.514014    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:23:57.517180 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:23:57.517150    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eece173_dc16_481e_b5f1_c5ca210b5207.slice/crio-bef427bbde0a191222e9a7d8d2ada08934979e00d954f04632f136bbf2846a90 WatchSource:0}: Error finding container bef427bbde0a191222e9a7d8d2ada08934979e00d954f04632f136bbf2846a90: Status 404 returned error can't find the container with id bef427bbde0a191222e9a7d8d2ada08934979e00d954f04632f136bbf2846a90
Sep 15 21:23:57.561247 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.561216    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.658192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.658165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:57.703826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.703801    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:23:57.707772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.707755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.710064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.710045    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-6f66f7\""
Sep 15 21:23:57.710152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.710112    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-6f66f7-dockercfg-vtsv5\""
Sep 15 21:23:57.720828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.720809    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:23:57.782519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.782460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsjr\" (UniqueName: \"kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.782627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.782539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.883340 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.883311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.883457 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.883370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsjr\" (UniqueName: \"kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.883980 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.883937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.891878 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.891855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" event={"ID":"1eece173-dc16-481e-b5f1-c5ca210b5207","Type":"ContainerStarted","Data":"bef427bbde0a191222e9a7d8d2ada08934979e00d954f04632f136bbf2846a90"}
Sep 15 21:23:57.892246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.892228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsjr\" (UniqueName: \"kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr\") pod \"payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:57.991859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:57.991835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:58.017592 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:58.017573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:23:58.298147 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:58.297834    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:23:58.301007 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:23:58.300976    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f27dbbf_5b40_4278_bc02_ffe15fe5c73f.slice/crio-0dd00e15a78bf167c490e0e079803e0c0b5507b5485e10ac11958db254a83348 WatchSource:0}: Error finding container 0dd00e15a78bf167c490e0e079803e0c0b5507b5485e10ac11958db254a83348: Status 404 returned error can't find the container with id 0dd00e15a78bf167c490e0e079803e0c0b5507b5485e10ac11958db254a83348
Sep 15 21:23:58.849504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:58.849470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:58.897852 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:58.897818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" event={"ID":"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f","Type":"ContainerStarted","Data":"0dd00e15a78bf167c490e0e079803e0c0b5507b5485e10ac11958db254a83348"}
Sep 15 21:23:58.912683 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:58.912644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:59.063338 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.063296    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:59.378004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.377968    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:59.475670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.475633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:59.814669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.814644    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:23:59.819146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.819129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:23:59.821872 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.821853    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-318c22-serving-cert\""
Sep 15 21:23:59.828898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.828844    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:23:59.855042 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.855014    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:23:59.901236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.901208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:23:59.901342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.901252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:23:59.901342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.901304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkh7\" (UniqueName: \"kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:23:59.901458 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.901343    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:23:59.903560 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.903540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" event={"ID":"1eece173-dc16-481e-b5f1-c5ca210b5207","Type":"ContainerStarted","Data":"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"}
Sep 15 21:23:59.903676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.903661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:23:59.921822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.921777    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" podStartSLOduration=1.659675258 podStartE2EDuration="3.921760912s" totalImagesPullingTime="2.262085654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:23:59.92107686 +0000 UTC m=+835.528773966" watchObservedRunningTime="2026-09-15 21:23:59.921760912 +0000 UTC m=+835.529458002"
Sep 15 21:23:59.927064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:23:59.927041    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.001795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.001761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.002005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.001814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.002005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.001839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkh7\" (UniqueName: \"kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.002005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.001870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.002761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.002721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.005534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.005293    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.005897 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.005879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.010467 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.010441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkh7\" (UniqueName: \"kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7\") pod \"maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.048640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.048557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.137896 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.137862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:00.365124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.365053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.429457 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.429427    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:24:00.467062 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.467029    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:00.686358 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:00.686288    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4081e10_3565_477f_8b0a_711f37d2ac89.slice/crio-430e00aa3dec53863e53de8224c558557c3d3d6ce3b179ec3e64ba2cc878ca88 WatchSource:0}: Error finding container 430e00aa3dec53863e53de8224c558557c3d3d6ce3b179ec3e64ba2cc878ca88: Status 404 returned error can't find the container with id 430e00aa3dec53863e53de8224c558557c3d3d6ce3b179ec3e64ba2cc878ca88
Sep 15 21:24:00.910615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.910562    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" event={"ID":"b4081e10-3565-477f-8b0a-711f37d2ac89","Type":"ContainerStarted","Data":"430e00aa3dec53863e53de8224c558557c3d3d6ce3b179ec3e64ba2cc878ca88"}
Sep 15 21:24:00.912120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.912084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" event={"ID":"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f","Type":"ContainerStarted","Data":"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"}
Sep 15 21:24:00.957158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:00.957098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.057177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.057148    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.284479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.284426    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" podStartSLOduration=1.858758233 podStartE2EDuration="4.284402431s" totalImagesPullingTime="2.425644198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:00.929996118 +0000 UTC m=+836.537693206" watchObservedRunningTime="2026-09-15 21:24:01.284402431 +0000 UTC m=+836.892099520"
Sep 15 21:24:01.284760 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.284738    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:24:01.288182 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.288151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.290430 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.290409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-04c28d-openshift-default-dockercfg-pttmr\""
Sep 15 21:24:01.301306 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.301284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:24:01.318209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.318172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.413193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nq4g\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.413663 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.413551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.438965 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.438922    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.514302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nq4g\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514505    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.514873 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.515006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.514988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.515096 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.515075    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.515311 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.515295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.516602 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.516567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.517139 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.517059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.522467 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.522443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.522687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.522668    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nq4g\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g\") pod \"e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") " pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.598840 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.598814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:01.808876 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.808791    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.877803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.877440    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:24:01.880255 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:01.880231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7f60b0_63bc_4509_8620_af9b5243ec12.slice/crio-c4ae24a1a41166b66db42f708771ed756f232ec7aeea53b6fa62dd464e0db74f WatchSource:0}: Error finding container c4ae24a1a41166b66db42f708771ed756f232ec7aeea53b6fa62dd464e0db74f: Status 404 returned error can't find the container with id c4ae24a1a41166b66db42f708771ed756f232ec7aeea53b6fa62dd464e0db74f
Sep 15 21:24:01.918431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.918403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" event={"ID":"b4081e10-3565-477f-8b0a-711f37d2ac89","Type":"ContainerStarted","Data":"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"}
Sep 15 21:24:01.918786 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.918536    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:01.919667 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.919642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerStarted","Data":"c4ae24a1a41166b66db42f708771ed756f232ec7aeea53b6fa62dd464e0db74f"}
Sep 15 21:24:01.919795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.919725    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:24:01.920388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.920369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:01.942178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:01.942132    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" podStartSLOduration=2.457856796 podStartE2EDuration="2.94211444s" totalImagesPullingTime="484.257644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:01.941149325 +0000 UTC m=+837.548846413" watchObservedRunningTime="2026-09-15 21:24:01.94211444 +0000 UTC m=+837.549811529"
Sep 15 21:24:02.128061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:02.127982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.436083 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:02.436009    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:02.629935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:02.629901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:03.002029 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:03.001986    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.148031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.147998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.505093 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.505059    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:04.505174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.505129    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:04.505174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.505159    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:04.772008 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.771917    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:04.937405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.937372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerStarted","Data":"4a56be4bc681f6a330f90d9e53d94a74184cd822076783db37ef04a372981abb"}
Sep 15 21:24:04.961163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:04.961109    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podStartSLOduration=1.338593245 podStartE2EDuration="3.961089599s" totalImagesPullingTime="2.622496354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:04.959683909 +0000 UTC m=+840.567380995" watchObservedRunningTime="2026-09-15 21:24:04.961089599 +0000 UTC m=+840.568786687"
Sep 15 21:24:05.056003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.055906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.156302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.156276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:05.599939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.599905    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:05.604321 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.604297    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:05.917833 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.917767    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:24:05.941128 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.941102    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:05.942399 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:05.942382    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:06.166960 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:06.166916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:07.222302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:07.222260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:07.323959 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:07.323916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:07.931912 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:07.931887    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:24:08.327198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.327165    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:08.330724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.330706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.333036 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.332997    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d0431a5e-serving-cert\""
Sep 15 21:24:08.343025 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.343005    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:08.426333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.426305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:08.472934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.472909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.473055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.472942    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.473055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.472995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.473055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.473012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvrx\" (UniqueName: \"kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.526047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.526019    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:08.574185 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.574157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.574267 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.574195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.574267 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.574218    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.574267 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.574235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvrx\" (UniqueName: \"kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.574409 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:08.574312    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-serving-cert: secret "maas-api-e2e-ait-d0431a5e-serving-cert" not found
Sep 15 21:24:08.574409 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:08.574381    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls podName:c25a222d-e42c-4e27-9681-4652cc8206dc nodeName:}" failed. No retries permitted until 2026-09-15 21:24:09.074361649 +0000 UTC m=+844.682058715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls") pod "maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc") : secret "maas-api-e2e-ait-d0431a5e-serving-cert" not found
Sep 15 21:24:08.574873 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.574854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.576598 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.576578    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:08.597385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:08.597328    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvrx\" (UniqueName: \"kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:09.078839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.078808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:09.079016 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:09.078937    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-serving-cert: secret "maas-api-e2e-ait-d0431a5e-serving-cert" not found
Sep 15 21:24:09.079016 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:09.079007    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls podName:c25a222d-e42c-4e27-9681-4652cc8206dc nodeName:}" failed. No retries permitted until 2026-09-15 21:24:10.078993845 +0000 UTC m=+845.686690915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls") pod "maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc") : secret "maas-api-e2e-ait-d0431a5e-serving-cert" not found
Sep 15 21:24:09.171728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.171699    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:09.270063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.270033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:09.605047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.605015    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:24:09.608629 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.608608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.610724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.610707    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-04c28d-serving-cert\""
Sep 15 21:24:09.618284 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.618262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:24:09.647260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.647239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:09.683447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.683424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.683533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.683469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.683533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.683505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkncr\" (UniqueName: \"kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.683617 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.683544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.750484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.750465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:09.784757 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.784739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.784851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.784784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.784851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.784813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkncr\" (UniqueName: \"kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.784925 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.784858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.784925 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:09.784899    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-serving-cert: secret "maas-api-e2e-autores-04c28d-serving-cert" not found
Sep 15 21:24:09.785012 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:09.784994    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls podName:7d573e49-8233-4518-8137-dc8ceb5d05da nodeName:}" failed. No retries permitted until 2026-09-15 21:24:10.284974444 +0000 UTC m=+845.892671513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls") pod "maas-api-e2e-autores-04c28d-748849f6db-hn9b5" (UID: "7d573e49-8233-4518-8137-dc8ceb5d05da") : secret "maas-api-e2e-autores-04c28d-serving-cert" not found
Sep 15 21:24:09.785490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.785467    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.787044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.787027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.792524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.792505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkncr\" (UniqueName: \"kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:09.852133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:09.852108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.045516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.045490    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.086978 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.086942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:10.089261 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.089235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:10.139824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.139806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:10.146567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.146547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.246560 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.246530    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.289529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.289501    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:10.291741 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.291721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") pod \"maas-api-e2e-autores-04c28d-748849f6db-hn9b5\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:10.320348 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.320297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.384701 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.384674    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.410132 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.410110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:10.412285 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:10.412261    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25a222d_e42c_4e27_9681_4652cc8206dc.slice/crio-595f863d26b01407dad8fc9c45124f070daa602374903b8910c00cee1f92a6bd WatchSource:0}: Error finding container 595f863d26b01407dad8fc9c45124f070daa602374903b8910c00cee1f92a6bd: Status 404 returned error can't find the container with id 595f863d26b01407dad8fc9c45124f070daa602374903b8910c00cee1f92a6bd
Sep 15 21:24:10.520051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.520027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:10.701907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.701840    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.788969 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.788931    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:24:10.791756 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:10.791723    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d573e49_8233_4518_8137_dc8ceb5d05da.slice/crio-788bff57ace88122f1f8ce8e1dd1add98118d82483bf3153692413d4e3815200 WatchSource:0}: Error finding container 788bff57ace88122f1f8ce8e1dd1add98118d82483bf3153692413d4e3815200: Status 404 returned error can't find the container with id 788bff57ace88122f1f8ce8e1dd1add98118d82483bf3153692413d4e3815200
Sep 15 21:24:10.791844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.791809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:10.971875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.971838    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" event={"ID":"7d573e49-8233-4518-8137-dc8ceb5d05da","Type":"ContainerStarted","Data":"788bff57ace88122f1f8ce8e1dd1add98118d82483bf3153692413d4e3815200"}
Sep 15 21:24:10.973484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.973457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" event={"ID":"c25a222d-e42c-4e27-9681-4652cc8206dc","Type":"ContainerStarted","Data":"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"}
Sep 15 21:24:10.973632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.973507    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" event={"ID":"c25a222d-e42c-4e27-9681-4652cc8206dc","Type":"ContainerStarted","Data":"595f863d26b01407dad8fc9c45124f070daa602374903b8910c00cee1f92a6bd"}
Sep 15 21:24:10.973632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.973565    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:10.992198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.992159    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" podStartSLOduration=2.656598035 podStartE2EDuration="2.992145451s" totalImagesPullingTime="335.547416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:10.991383525 +0000 UTC m=+846.599080614" watchObservedRunningTime="2026-09-15 21:24:10.992145451 +0000 UTC m=+846.599842538"
Sep 15 21:24:10.993323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:10.993298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.202346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.202321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.468718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.468689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.568573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.568538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.667959 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.667926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:11.984340 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.984300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" event={"ID":"7d573e49-8233-4518-8137-dc8ceb5d05da","Type":"ContainerStarted","Data":"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"}
Sep 15 21:24:11.984720 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:11.984457    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:12.002174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:12.002130    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" podStartSLOduration=2.634501407 podStartE2EDuration="3.002117483s" totalImagesPullingTime="367.616076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:12.000932077 +0000 UTC m=+847.608629185" watchObservedRunningTime="2026-09-15 21:24:12.002117483 +0000 UTC m=+847.609814611"
Sep 15 21:24:12.719990 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:12.719962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:12.928400 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:12.928373    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:24:13.211074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:13.211046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.373123 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:13.373094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.496675 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:13.496621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.712131 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:13.712103    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:13.815352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:13.815294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:14.579282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:14.579251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.226620 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.226590    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.443813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.443786    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.547937 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.547856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.643002 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.642969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.750013 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.749984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:15.861985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:15.861906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:16.292594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:16.292558    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:16.461436 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:16.461402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:16.989570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:16.989543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:17.374693 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:17.374613    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:17.531733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:17.531691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:24:17.993108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:17.993077    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:24:18.100514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:18.100479    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:18.439911 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:18.439842    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.210224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.210189    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:24:19.213696 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.213675    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.216079 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.216058    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f457e5-serving-cert\""
Sep 15 21:24:19.223847 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.223822    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:24:19.256966 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.256926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.316072 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.316051    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.360289 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.360261    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.360390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.360301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.360390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.360318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt7r2\" (UniqueName: \"kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.360390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.360337    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.461385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.461332    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.461385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.461366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.461385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.461384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt7r2\" (UniqueName: \"kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.461559 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.461405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.461559 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:19.461512    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-serving-cert: secret "maas-api-e2e-inf-b-f457e5-serving-cert" not found
Sep 15 21:24:19.461639 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:19.461570    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls podName:b140f4cd-40fd-4545-9e06-a2cef7cb52bd nodeName:}" failed. No retries permitted until 2026-09-15 21:24:19.961553537 +0000 UTC m=+855.569250607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls") pod "maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" (UID: "b140f4cd-40fd-4545-9e06-a2cef7cb52bd") : secret "maas-api-e2e-inf-b-f457e5-serving-cert" not found
Sep 15 21:24:19.461986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.461967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.463642 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.463626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.472094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.472071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt7r2\" (UniqueName: \"kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.610593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.610562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.770865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.770797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.864573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.864541    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:19.870837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.870811    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:24:19.874095 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.874065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:19.876111 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.876095    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-f457e5\""
Sep 15 21:24:19.884028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.884009    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:24:19.903220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.903199    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:24:19.906142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.906124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:19.908129 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.908109    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-f457e5-dockercfg-rmqcb\""
Sep 15 21:24:19.915510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.915491    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:24:19.965446 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.965422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:19.967585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:19.967563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") pod \"maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:20.066836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.066749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.067024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.066843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.067024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.066928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk8dv\" (UniqueName: \"kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.067024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.066979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8bc\" (UniqueName: \"kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.125643 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.125597    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:20.168197 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.168164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk8dv\" (UniqueName: \"kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.168197 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.168198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8bc\" (UniqueName: \"kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.168378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.168237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.168378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.168263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.168981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.168941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.169247 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.169229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.178494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.178465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8bc\" (UniqueName: \"kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc\") pod \"payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") " pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.178671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.178654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk8dv\" (UniqueName: \"kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv\") pod \"payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.184137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.184117    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:20.186644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.186542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:20.215801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.215559    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:20.416187 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.416161    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:24:20.418486 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:20.418460    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb140f4cd_40fd_4545_9e06_a2cef7cb52bd.slice/crio-7541c5f8bb9bef6299682f3b19c6ed29089c3cd671ae9bfa8275ca6ad6e8eb40 WatchSource:0}: Error finding container 7541c5f8bb9bef6299682f3b19c6ed29089c3cd671ae9bfa8275ca6ad6e8eb40: Status 404 returned error can't find the container with id 7541c5f8bb9bef6299682f3b19c6ed29089c3cd671ae9bfa8275ca6ad6e8eb40
Sep 15 21:24:20.485798 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.485771    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:24:20.487524 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:20.487493    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda600745_58c0_4c79_b5e4_41b89a5a64a1.slice/crio-713f9f769ad6afab48264ed1f9c35a2a067eb257df678c123baab1073fc33dee WatchSource:0}: Error finding container 713f9f769ad6afab48264ed1f9c35a2a067eb257df678c123baab1073fc33dee: Status 404 returned error can't find the container with id 713f9f769ad6afab48264ed1f9c35a2a067eb257df678c123baab1073fc33dee
Sep 15 21:24:20.532133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.532111    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:24:20.998905 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:20.998870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:21.024969 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.024920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" event={"ID":"b140f4cd-40fd-4545-9e06-a2cef7cb52bd","Type":"ContainerStarted","Data":"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"}
Sep 15 21:24:21.025124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.024992    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" event={"ID":"b140f4cd-40fd-4545-9e06-a2cef7cb52bd","Type":"ContainerStarted","Data":"7541c5f8bb9bef6299682f3b19c6ed29089c3cd671ae9bfa8275ca6ad6e8eb40"}
Sep 15 21:24:21.025124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.025023    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:21.026398 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.026371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" event={"ID":"da600745-58c0-4c79-b5e4-41b89a5a64a1","Type":"ContainerStarted","Data":"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"}
Sep 15 21:24:21.026533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.026423    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" event={"ID":"da600745-58c0-4c79-b5e4-41b89a5a64a1","Type":"ContainerStarted","Data":"713f9f769ad6afab48264ed1f9c35a2a067eb257df678c123baab1073fc33dee"}
Sep 15 21:24:21.026533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.026453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:21.027702 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.027680    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" event={"ID":"5c3d4154-8186-4939-ac6e-5f77c614f821","Type":"ContainerStarted","Data":"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"}
Sep 15 21:24:21.027796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.027718    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" event={"ID":"5c3d4154-8186-4939-ac6e-5f77c614f821","Type":"ContainerStarted","Data":"968ac94f3a222100f700e66d9a7dec367c0bf25725e9f37b36655c8fb87285d7"}
Sep 15 21:24:21.027858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.027822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:21.053974 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.043806    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" podStartSLOduration=1.61841949 podStartE2EDuration="2.043790237s" totalImagesPullingTime="425.370747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:21.041295527 +0000 UTC m=+856.648992615" watchObservedRunningTime="2026-09-15 21:24:21.043790237 +0000 UTC m=+856.651487331"
Sep 15 21:24:21.069045 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.068991    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" podStartSLOduration=2.068930251 podStartE2EDuration="2.068930251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:21.068294946 +0000 UTC m=+856.675992035" watchObservedRunningTime="2026-09-15 21:24:21.068930251 +0000 UTC m=+856.676627339"
Sep 15 21:24:21.086496 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.086450    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" podStartSLOduration=2.086436244 podStartE2EDuration="2.086436244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:21.08544701 +0000 UTC m=+856.693144098" watchObservedRunningTime="2026-09-15 21:24:21.086436244 +0000 UTC m=+856.694133332"
Sep 15 21:24:21.849012 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:21.848976    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:22.746225 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:22.746189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:23.560345 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:23.560308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:24.276489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:24.276458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:25.040320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:25.040283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:26.151738 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:26.151694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:26.928495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:26.928466    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:27.029275 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:27.029246    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:27.036975 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:27.036938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:24:27.680155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:27.680119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:28.454416 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:28.454365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:29.080121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.080092    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerID="4a56be4bc681f6a330f90d9e53d94a74184cd822076783db37ef04a372981abb" exitCode=0
Sep 15 21:24:29.080461 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.080162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerDied","Data":"4a56be4bc681f6a330f90d9e53d94a74184cd822076783db37ef04a372981abb"}
Sep 15 21:24:29.080510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.080469    2558 scope.go:117] "RemoveContainer" containerID="4a56be4bc681f6a330f90d9e53d94a74184cd822076783db37ef04a372981abb"
Sep 15 21:24:29.081466 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.081441    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:29.081518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.081501    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:29.081561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.081550    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:29.257009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:29.256889    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:30.021528 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.021493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:30.088600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.088569    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerStarted","Data":"8a8aaf6fa35e46514b6fe7dd951ece74edd959de163b96eaf817cfff52e06fc4"}
Sep 15 21:24:30.504596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.504570    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:30.599312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.599286    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:30.599452 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.599431    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:30.599496 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.599479    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:30.760108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:30.760019    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:31.600151 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:31.600116    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:31.600509 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:31.600175    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:31.620665 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:31.620639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:32.033538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:32.033512    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:24:32.033733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:32.033625    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:24:32.429881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:32.429800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:32.599245 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:32.599210    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:32.599394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:32.599265    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:33.257866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:33.257835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:33.599848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:33.599776    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:33.599848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:33.599827    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:34.169493 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:34.169464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:34.599180 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:34.599149    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:34.599534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:34.599202    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:34.970419 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:34.970384    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.600103 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:35.600063    2558 patch_prober.go:28] interesting pod/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body=
Sep 15 21:24:35.600450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:35.600131    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused"
Sep 15 21:24:35.757883 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:35.757852    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:35.941920 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:35.941833    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:36.427844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.427813    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:36.428067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.428040    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" podUID="c25a222d-e42c-4e27-9681-4652cc8206dc" containerName="maas-api" containerID="cri-o://797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a" gracePeriod=30
Sep 15 21:24:36.461842 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.461809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.557050 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.557023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.604309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.604284    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:36.605370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.605353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:24:36.615151 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.615125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.677521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.677495    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:36.700498 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.700433    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.708365 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs\") pod \"c25a222d-e42c-4e27-9681-4652cc8206dc\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") "
Sep 15 21:24:36.708477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca\") pod \"c25a222d-e42c-4e27-9681-4652cc8206dc\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") "
Sep 15 21:24:36.708477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708408    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bvrx\" (UniqueName: \"kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx\") pod \"c25a222d-e42c-4e27-9681-4652cc8206dc\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") "
Sep 15 21:24:36.708558 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708486    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") pod \"c25a222d-e42c-4e27-9681-4652cc8206dc\" (UID: \"c25a222d-e42c-4e27-9681-4652cc8206dc\") "
Sep 15 21:24:36.708764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708731    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c25a222d-e42c-4e27-9681-4652cc8206dc" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:24:36.708855 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.708828    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c25a222d-e42c-4e27-9681-4652cc8206dc-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:24:36.710976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.710922    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx" (OuterVolumeSpecName: "kube-api-access-6bvrx") pod "c25a222d-e42c-4e27-9681-4652cc8206dc" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc"). InnerVolumeSpecName "kube-api-access-6bvrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:24:36.711067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.711025    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c25a222d-e42c-4e27-9681-4652cc8206dc" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:24:36.711125 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.711082    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c25a222d-e42c-4e27-9681-4652cc8206dc" (UID: "c25a222d-e42c-4e27-9681-4652cc8206dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:24:36.760412 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.760390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:36.809856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.809829    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:24:36.809856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.809854    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c25a222d-e42c-4e27-9681-4652cc8206dc-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:24:36.810006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.809867    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvrx\" (UniqueName: \"kubernetes.io/projected/c25a222d-e42c-4e27-9681-4652cc8206dc-kube-api-access-6bvrx\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:24:36.876448 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:36.876418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:37.119119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.119091    2558 generic.go:356] "Generic (PLEG): container finished" podID="c25a222d-e42c-4e27-9681-4652cc8206dc" containerID="797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a" exitCode=0
Sep 15 21:24:37.119252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.119131    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"
Sep 15 21:24:37.119252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.119160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" event={"ID":"c25a222d-e42c-4e27-9681-4652cc8206dc","Type":"ContainerDied","Data":"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"}
Sep 15 21:24:37.119252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.119194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg" event={"ID":"c25a222d-e42c-4e27-9681-4652cc8206dc","Type":"ContainerDied","Data":"595f863d26b01407dad8fc9c45124f070daa602374903b8910c00cee1f92a6bd"}
Sep 15 21:24:37.119252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.119214    2558 scope.go:117] "RemoveContainer" containerID="797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"
Sep 15 21:24:37.127520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.127503    2558 scope.go:117] "RemoveContainer" containerID="797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"
Sep 15 21:24:37.127752 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:24:37.127737    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a\": container with ID starting with 797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a not found: ID does not exist" containerID="797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"
Sep 15 21:24:37.127802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.127758    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a"} err="failed to get container status \"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a\": rpc error: code = NotFound desc = could not find container \"797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a\": container with ID starting with 797347dd195e94b79f04589b16a82a3b8741d765522f7bc40510f6dec6ed3b6a not found: ID does not exist"
Sep 15 21:24:37.134594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.134574    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:37.138885 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.138867    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d0431a5e-768cb78c-mqhmg"]
Sep 15 21:24:37.208580 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.208559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:37.554536 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.554507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:37.654371 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.654347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:37.777957 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:37.777917    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.047593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.047571    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:24:38.047903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.047891    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c25a222d-e42c-4e27-9681-4652cc8206dc" containerName="maas-api"
Sep 15 21:24:38.047941 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.047905    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c25a222d-e42c-4e27-9681-4652cc8206dc" containerName="maas-api"
Sep 15 21:24:38.048004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.047999    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c25a222d-e42c-4e27-9681-4652cc8206dc" containerName="maas-api"
Sep 15 21:24:38.050567 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.050549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.052703 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.052686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-edbfd1c5-gw-openshift-default-dockercfg-njphs\""
Sep 15 21:24:38.063933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.063906    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:24:38.079529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.079510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.119969 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.119938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.119982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120372 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.120372 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.120285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.178579 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.178554    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.221433 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.221382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222187 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222549 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222549 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222566    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.222745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.222682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.223146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.223126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.223324 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.223295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.223390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.223295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.223466 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.223408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.223789 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.223767    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.225599 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.225572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.225798 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.225780    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.239506 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.239481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.239802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.239784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv\") pod \"e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") " pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.317078 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.317021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:38.360509 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.360486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:38.635953 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.635921    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:24:38.637766 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:24:38.637734    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d8fa71_5785_48f4_ba4f_23ab9fe38db5.slice/crio-69fd3b7c88476bfec2bacc76acda48c8336ecab76b4e1cfaabdf5c0e01b055f0 WatchSource:0}: Error finding container 69fd3b7c88476bfec2bacc76acda48c8336ecab76b4e1cfaabdf5c0e01b055f0: Status 404 returned error can't find the container with id 69fd3b7c88476bfec2bacc76acda48c8336ecab76b4e1cfaabdf5c0e01b055f0
Sep 15 21:24:38.639879 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.639852    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:38.639929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.639914    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:38.639977 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.639942    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:24:38.962889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.962852    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c25a222d-e42c-4e27-9681-4652cc8206dc" path="/var/lib/kubelet/pods/c25a222d-e42c-4e27-9681-4652cc8206dc/volumes"
Sep 15 21:24:38.971734 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:38.971707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.130169 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.130132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerStarted","Data":"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"}
Sep 15 21:24:39.130313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.130199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerStarted","Data":"69fd3b7c88476bfec2bacc76acda48c8336ecab76b4e1cfaabdf5c0e01b055f0"}
Sep 15 21:24:39.150112 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.150061    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podStartSLOduration=1.150047059 podStartE2EDuration="1.150047059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:24:39.148460399 +0000 UTC m=+874.756157487" watchObservedRunningTime="2026-09-15 21:24:39.150047059 +0000 UTC m=+874.757744146"
Sep 15 21:24:39.361028 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.360930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:39.365715 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.365689    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:39.541155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.541114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.636203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.636109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:39.816606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:39.816578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.006200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.006172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.135573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.135554    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:40.136530 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.136516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:24:40.510368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.510341    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:24:40.833342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.833241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:40.932515 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:40.932487    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:41.032960 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:41.032926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:41.690354 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:41.690323    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:42.468056 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:42.468025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:42.571365 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:42.571337    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:42.766077 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:42.765994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.005858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:43.005828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.090837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:43.090720    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:43.463658 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:43.463632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:44.470761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:44.470726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:45.245127 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:45.245094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.129178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:46.129143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.383096 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:46.383020    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.497334 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:46.497293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.586233 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:46.586200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:46.740256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:46.740227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:47.088210 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:47.088128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:52.805870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:52.805832    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:52.870246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:52.870214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:24:59.722117 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:24:59.722076    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:25:00.225006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.224976    2558 generic.go:356] "Generic (PLEG): container finished" podID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerID="84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659" exitCode=0
Sep 15 21:25:00.225191 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.225061    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerDied","Data":"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"}
Sep 15 21:25:00.225459 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.225445    2558 scope.go:117] "RemoveContainer" containerID="84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"
Sep 15 21:25:00.226531 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.226499    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:00.226644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.226580    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:00.226644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:00.226625    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:01.231017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:01.230983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerStarted","Data":"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"}
Sep 15 21:25:01.361126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:01.361084    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:01.361448 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:01.361410    2558 patch_prober.go:28] interesting pod/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 21:25:01.361562 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:01.361466    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 21:25:02.361654 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:02.361604    2558 patch_prober.go:28] interesting pod/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 21:25:02.362189 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:02.361663    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 21:25:03.306258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:03.306230    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:03.361719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:03.361681    2558 patch_prober.go:28] interesting pod/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 21:25:03.362081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:03.361747    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 21:25:04.361221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:04.361185    2558 patch_prober.go:28] interesting pod/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 21:25:04.361516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:04.361486    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 21:25:04.554909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:04.554831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:05.339378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:05.339330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:05.361296 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:05.361256    2558 patch_prober.go:28] interesting pod/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 15 21:25:05.361445 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:05.361324    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 15 21:25:06.187504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:06.187464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:06.471189 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:06.471156    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:06.471591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:06.471571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:06.472442 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:06.472424    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:07.050437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:07.050404    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:07.767440 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:07.767403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:08.712879 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:08.712849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:09.488272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:09.488238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:10.180979 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:10.180930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:11.051146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:11.051114    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:11.525209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:11.525177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:11.980088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:11.980045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.298787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.298703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.601672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.601593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.670002 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.669973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.767637 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.767607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.844235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.844208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:12.941124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.940935    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:25:12.941330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.941306    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy" containerID="cri-o://9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6" gracePeriod=30
Sep 15 21:25:12.962641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:12.962611    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:13.260107 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:13.260078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:13.438095 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:13.438055    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:13.736546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:13.736509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:14.107600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:14.107509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:14.161930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:14.161904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:14.930061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:14.930032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:15.728204 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:15.728174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:16.441597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:16.441552    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:16.536773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:16.536744    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:16.637162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:16.637132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:17.555027 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:17.554996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.178288 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.178267    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:18.258295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258260    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258299    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258334    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258387    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258444    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258468    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258501    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258559    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token\") pod \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\" (UID: \"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5\") "
Sep 15 21:25:18.258811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258579    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:18.258811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258669    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:18.258811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258804    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:18.259035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258829    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:18.259035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258889    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.259035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258907    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.259035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.258921    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.259199 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.259096    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:18.260730 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.260708    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:18.260904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.260749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv" (OuterVolumeSpecName: "kube-api-access-j6vmv") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "kube-api-access-j6vmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:18.260904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.260822    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:25:18.260904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.260841    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" (UID: "a1d8fa71-5785-48f4-ba4f-23ab9fe38db5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:25:18.325044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.325015    2558 generic.go:356] "Generic (PLEG): container finished" podID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerID="9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6" exitCode=0
Sep 15 21:25:18.325162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.325066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerDied","Data":"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"}
Sep 15 21:25:18.325162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.325084    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"
Sep 15 21:25:18.325162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.325108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds" event={"ID":"a1d8fa71-5785-48f4-ba4f-23ab9fe38db5","Type":"ContainerDied","Data":"69fd3b7c88476bfec2bacc76acda48c8336ecab76b4e1cfaabdf5c0e01b055f0"}
Sep 15 21:25:18.325162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.325134    2558 scope.go:117] "RemoveContainer" containerID="9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"
Sep 15 21:25:18.331919 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.331898    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:18.332277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332261    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.332353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332281    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.332353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332304    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.332353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332312    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.332548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332387    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.332548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.332400    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" containerName="istio-proxy"
Sep 15 21:25:18.335111 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.335089    2558 scope.go:117] "RemoveContainer" containerID="84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"
Sep 15 21:25:18.336467 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.336452    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.338319 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.338303    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c1fb6d5a-serving-cert\""
Sep 15 21:25:18.344581 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.344424    2558 scope.go:117] "RemoveContainer" containerID="9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"
Sep 15 21:25:18.345595 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.345522    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:18.346733 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:18.346629    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6\": container with ID starting with 9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6 not found: ID does not exist" containerID="9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"
Sep 15 21:25:18.346733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.346665    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6"} err="failed to get container status \"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6\": rpc error: code = NotFound desc = could not find container \"9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6\": container with ID starting with 9e5f75de1edf60a5bb1cf829e9d1600f33467881beb579077c918deed02993b6 not found: ID does not exist"
Sep 15 21:25:18.346733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.346688    2558 scope.go:117] "RemoveContainer" containerID="84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"
Sep 15 21:25:18.347239 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:18.347213    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659\": container with ID starting with 84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659 not found: ID does not exist" containerID="84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"
Sep 15 21:25:18.347330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.347245    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659"} err="failed to get container status \"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659\": rpc error: code = NotFound desc = could not find container \"84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659\": container with ID starting with 84dde0aae4a56c1719a82163bcdcaaa7585d4c15b81bb261c5d1411f174aa659 not found: ID does not exist"
Sep 15 21:25:18.353492 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.353472    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:25:18.359869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.359842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.359976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.359890    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-edbfd1c5-gw-openshift-default-5895b88964-w6cds"]
Sep 15 21:25:18.359976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.359919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.360051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.359975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.360051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrvm\" (UniqueName: \"kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.360118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360085    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6vmv\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-kube-api-access-j6vmv\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.360118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360098    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.360118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360112    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.360200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360119    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.360200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360127    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.360200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.360134    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:18.366565 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.366547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.460645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.460617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.460790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.460662    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.460851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.460838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.460886 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.460878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grrvm\" (UniqueName: \"kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.461021 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:18.461000    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-serving-cert: secret "maas-api-e2e-ait-c1fb6d5a-serving-cert" not found
Sep 15 21:25:18.461115 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:18.461088    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls podName:8f9634ea-576c-43c3-87db-0977c95fe08e nodeName:}" failed. No retries permitted until 2026-09-15 21:25:18.961065326 +0000 UTC m=+914.568762408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls") pod "maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" (UID: "8f9634ea-576c-43c3-87db-0977c95fe08e") : secret "maas-api-e2e-ait-c1fb6d5a-serving-cert" not found
Sep 15 21:25:18.461408 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.461389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.462930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.462911    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.469338 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.469314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.470840 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.470819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrvm\" (UniqueName: \"kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.728460 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.728433    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.866175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.866143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.962756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.962717    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:18.963763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.963730    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d8fa71-5785-48f4-ba4f-23ab9fe38db5" path="/var/lib/kubelet/pods/a1d8fa71-5785-48f4-ba4f-23ab9fe38db5/volumes"
Sep 15 21:25:18.964066 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.964044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:18.966524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:18.966501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") pod \"maas-api-e2e-ait-c1fb6d5a-5584775988-wr958\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:19.001607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.001552    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:19.006153 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.006139    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.008710 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.008692    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c1fb6d5a\""
Sep 15 21:25:19.008793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.008710    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c1fb6d5a-dockercfg-k9qsq\""
Sep 15 21:25:19.022490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.022469    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:19.065402 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.065379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7t5s\" (UniqueName: \"kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.065508 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.065413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.166749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.166715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7t5s\" (UniqueName: \"kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.166905 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.166754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.167410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.167390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.174871 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.174849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7t5s\" (UniqueName: \"kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s\") pod \"payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") " pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.248972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.248934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:19.315216 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.315173    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:19.403723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.403696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:19.522492 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.522470    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:19.524513 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:25:19.524492    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9634ea_576c_43c3_87db_0977c95fe08e.slice/crio-b11e828bfa7df3a6304b70c312f49e5b952b275373d4b0d02f12cd327f1139ea WatchSource:0}: Error finding container b11e828bfa7df3a6304b70c312f49e5b952b275373d4b0d02f12cd327f1139ea: Status 404 returned error can't find the container with id b11e828bfa7df3a6304b70c312f49e5b952b275373d4b0d02f12cd327f1139ea
Sep 15 21:25:19.585103 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.585065    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:19.587018 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:25:19.586995    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fd01e2_9175_4a3c_8830_7a58b086581c.slice/crio-ca6dc233dfd01caf0474cfcd80646a598c5e737cd53db7763ea0cadefbe2ecd6 WatchSource:0}: Error finding container ca6dc233dfd01caf0474cfcd80646a598c5e737cd53db7763ea0cadefbe2ecd6: Status 404 returned error can't find the container with id ca6dc233dfd01caf0474cfcd80646a598c5e737cd53db7763ea0cadefbe2ecd6
Sep 15 21:25:19.617335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:19.617293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:25:20.246528 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.246492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:20.338407 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.338367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" event={"ID":"97fd01e2-9175-4a3c-8830-7a58b086581c","Type":"ContainerStarted","Data":"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"}
Sep 15 21:25:20.338561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.338472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" event={"ID":"97fd01e2-9175-4a3c-8830-7a58b086581c","Type":"ContainerStarted","Data":"ca6dc233dfd01caf0474cfcd80646a598c5e737cd53db7763ea0cadefbe2ecd6"}
Sep 15 21:25:20.338561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.338508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:20.339982 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.339958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" event={"ID":"8f9634ea-576c-43c3-87db-0977c95fe08e","Type":"ContainerStarted","Data":"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"}
Sep 15 21:25:20.340072 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.339996    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" event={"ID":"8f9634ea-576c-43c3-87db-0977c95fe08e","Type":"ContainerStarted","Data":"b11e828bfa7df3a6304b70c312f49e5b952b275373d4b0d02f12cd327f1139ea"}
Sep 15 21:25:20.340130 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.340096    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:20.356172 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.356130    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" podStartSLOduration=2.3561180520000002 podStartE2EDuration="2.356118052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:20.354231002 +0000 UTC m=+915.961928090" watchObservedRunningTime="2026-09-15 21:25:20.356118052 +0000 UTC m=+915.963815152"
Sep 15 21:25:20.374713 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:20.374675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" podStartSLOduration=2.037252678 podStartE2EDuration="2.374662404s" totalImagesPullingTime="337.409726ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:20.374076865 +0000 UTC m=+915.981773956" watchObservedRunningTime="2026-09-15 21:25:20.374662404 +0000 UTC m=+915.982359526"
Sep 15 21:25:21.082006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:21.081940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:21.764299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:21.764267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:26.350860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:26.350832    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:31.347385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:31.347359    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:39.605152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:39.605116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:25:40.380325 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:40.380281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:41.085231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:41.085200    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:42.041269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:42.041239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:42.851303 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:42.851219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:43.558015 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:43.557984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:44.353738 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:44.353703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:45.043537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:45.043504    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:45.745633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:45.745598    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:46.583425 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:46.583394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:47.276647 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.276615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:47.876220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.876188    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:47.876408 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.876385    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" podUID="8f9634ea-576c-43c3-87db-0977c95fe08e" containerName="maas-api" containerID="cri-o://ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0" gracePeriod=30
Sep 15 21:25:47.914057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.914032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:47.926136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.926112    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:47.926314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:47.926291    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" podUID="97fd01e2-9175-4a3c-8830-7a58b086581c" containerName="payload-processing" containerID="cri-o://1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f" gracePeriod=30
Sep 15 21:25:48.013577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.013550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:48.093448 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.093374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:48.161097 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.161075    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:48.187005 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.186969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:48.190144 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.190118    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:48.293215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293185    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7t5s\" (UniqueName: \"kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s\") pod \"97fd01e2-9175-4a3c-8830-7a58b086581c\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") "
Sep 15 21:25:48.293660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293232    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grrvm\" (UniqueName: \"kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm\") pod \"8f9634ea-576c-43c3-87db-0977c95fe08e\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") "
Sep 15 21:25:48.293660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293275    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume\") pod \"97fd01e2-9175-4a3c-8830-7a58b086581c\" (UID: \"97fd01e2-9175-4a3c-8830-7a58b086581c\") "
Sep 15 21:25:48.293660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca\") pod \"8f9634ea-576c-43c3-87db-0977c95fe08e\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") "
Sep 15 21:25:48.293660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293338    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") pod \"8f9634ea-576c-43c3-87db-0977c95fe08e\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") "
Sep 15 21:25:48.293660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs\") pod \"8f9634ea-576c-43c3-87db-0977c95fe08e\" (UID: \"8f9634ea-576c-43c3-87db-0977c95fe08e\") "
Sep 15 21:25:48.293913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293692    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97fd01e2-9175-4a3c-8830-7a58b086581c" (UID: "97fd01e2-9175-4a3c-8830-7a58b086581c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:48.293913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.293712    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f9634ea-576c-43c3-87db-0977c95fe08e" (UID: "8f9634ea-576c-43c3-87db-0977c95fe08e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:25:48.295476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.295450    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8f9634ea-576c-43c3-87db-0977c95fe08e" (UID: "8f9634ea-576c-43c3-87db-0977c95fe08e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:25:48.295476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.295466    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s" (OuterVolumeSpecName: "kube-api-access-j7t5s") pod "97fd01e2-9175-4a3c-8830-7a58b086581c" (UID: "97fd01e2-9175-4a3c-8830-7a58b086581c"). InnerVolumeSpecName "kube-api-access-j7t5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:48.295615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.295466    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f9634ea-576c-43c3-87db-0977c95fe08e" (UID: "8f9634ea-576c-43c3-87db-0977c95fe08e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:25:48.295615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.295455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm" (OuterVolumeSpecName: "kube-api-access-grrvm") pod "8f9634ea-576c-43c3-87db-0977c95fe08e" (UID: "8f9634ea-576c-43c3-87db-0977c95fe08e"). InnerVolumeSpecName "kube-api-access-grrvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394156    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7t5s\" (UniqueName: \"kubernetes.io/projected/97fd01e2-9175-4a3c-8830-7a58b086581c-kube-api-access-j7t5s\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394178    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grrvm\" (UniqueName: \"kubernetes.io/projected/8f9634ea-576c-43c3-87db-0977c95fe08e-kube-api-access-grrvm\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394187    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97fd01e2-9175-4a3c-8830-7a58b086581c-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394195    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9634ea-576c-43c3-87db-0977c95fe08e-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394204    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.394222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.394212    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f9634ea-576c-43c3-87db-0977c95fe08e-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:25:48.460627 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.460601    2558 generic.go:356] "Generic (PLEG): container finished" podID="8f9634ea-576c-43c3-87db-0977c95fe08e" containerID="ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0" exitCode=0
Sep 15 21:25:48.460769 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.460648    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"
Sep 15 21:25:48.460769 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.460691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" event={"ID":"8f9634ea-576c-43c3-87db-0977c95fe08e","Type":"ContainerDied","Data":"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"}
Sep 15 21:25:48.460769 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.460747    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958" event={"ID":"8f9634ea-576c-43c3-87db-0977c95fe08e","Type":"ContainerDied","Data":"b11e828bfa7df3a6304b70c312f49e5b952b275373d4b0d02f12cd327f1139ea"}
Sep 15 21:25:48.460928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.460775    2558 scope.go:117] "RemoveContainer" containerID="ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"
Sep 15 21:25:48.462101 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.462082    2558 generic.go:356] "Generic (PLEG): container finished" podID="97fd01e2-9175-4a3c-8830-7a58b086581c" containerID="1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f" exitCode=0
Sep 15 21:25:48.462215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.462108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" event={"ID":"97fd01e2-9175-4a3c-8830-7a58b086581c","Type":"ContainerDied","Data":"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"}
Sep 15 21:25:48.462215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.462127    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"
Sep 15 21:25:48.462215 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.462151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth" event={"ID":"97fd01e2-9175-4a3c-8830-7a58b086581c","Type":"ContainerDied","Data":"ca6dc233dfd01caf0474cfcd80646a598c5e737cd53db7763ea0cadefbe2ecd6"}
Sep 15 21:25:48.470343 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.470326    2558 scope.go:117] "RemoveContainer" containerID="ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"
Sep 15 21:25:48.470675 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:48.470653    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0\": container with ID starting with ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0 not found: ID does not exist" containerID="ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"
Sep 15 21:25:48.470764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.470678    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0"} err="failed to get container status \"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0\": rpc error: code = NotFound desc = could not find container \"ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0\": container with ID starting with ba902e88a4d51edf5895633f81b21b7808d77a314a276bac81f4c2405459b8f0 not found: ID does not exist"
Sep 15 21:25:48.470764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.470702    2558 scope.go:117] "RemoveContainer" containerID="1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"
Sep 15 21:25:48.478187 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.478171    2558 scope.go:117] "RemoveContainer" containerID="1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"
Sep 15 21:25:48.478425 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:48.478409    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f\": container with ID starting with 1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f not found: ID does not exist" containerID="1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"
Sep 15 21:25:48.478471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.478429    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f"} err="failed to get container status \"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f\": rpc error: code = NotFound desc = could not find container \"1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f\": container with ID starting with 1901c46ed628228915bc6af85209997e29a5de44e2e7cb03156235fea406d34f not found: ID does not exist"
Sep 15 21:25:48.485628 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.485604    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:48.491522 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.491502    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1fb6d5a-5584775988-wr958"]
Sep 15 21:25:48.504709 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.504686    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:48.508809 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.508788    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1fb6d5a-6f9d8fbc8c-nvcth"]
Sep 15 21:25:48.961353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.961319    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9634ea-576c-43c3-87db-0977c95fe08e" path="/var/lib/kubelet/pods/8f9634ea-576c-43c3-87db-0977c95fe08e/volumes"
Sep 15 21:25:48.961719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:48.961699    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97fd01e2-9175-4a3c-8830-7a58b086581c" path="/var/lib/kubelet/pods/97fd01e2-9175-4a3c-8830-7a58b086581c/volumes"
Sep 15 21:25:49.139555 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:49.139488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:49.318901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:49.318873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:49.761413 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:49.761383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:50.024864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.024776    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:25:50.025155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025140    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9634ea-576c-43c3-87db-0977c95fe08e" containerName="maas-api"
Sep 15 21:25:50.025212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025157    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9634ea-576c-43c3-87db-0977c95fe08e" containerName="maas-api"
Sep 15 21:25:50.025212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025172    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97fd01e2-9175-4a3c-8830-7a58b086581c" containerName="payload-processing"
Sep 15 21:25:50.025212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025178    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97fd01e2-9175-4a3c-8830-7a58b086581c" containerName="payload-processing"
Sep 15 21:25:50.025304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025223    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97fd01e2-9175-4a3c-8830-7a58b086581c" containerName="payload-processing"
Sep 15 21:25:50.025304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.025232    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9634ea-576c-43c3-87db-0977c95fe08e" containerName="maas-api"
Sep 15 21:25:50.030887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.030311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.032672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.032641    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ce9161fd-openshift-default-dockercfg-gp7ft\""
Sep 15 21:25:50.041073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.041047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:25:50.058802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.058780    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:50.109252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109375 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109375 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109375 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js79d\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.109686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.109581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.160521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.160480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:50.211021 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.210983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211174 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js79d\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.211928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.211908    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.214338 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.214313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.214780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.214755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.221572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.221526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.221699 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.221679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js79d\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d\") pod \"e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") " pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.262409 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.262380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:50.343070 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.342999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:50.360717 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.360690    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:50.629073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.629003    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:25:50.632790 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:25:50.632768    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175d4633_45c3_4bdc_94f7_9a7978e9eb2a.slice/crio-a4ebf6677fea58a9ea3ad77482c9276b07590284b7dfa9a1de7985e206f8d7c7 WatchSource:0}: Error finding container a4ebf6677fea58a9ea3ad77482c9276b07590284b7dfa9a1de7985e206f8d7c7: Status 404 returned error can't find the container with id a4ebf6677fea58a9ea3ad77482c9276b07590284b7dfa9a1de7985e206f8d7c7
Sep 15 21:25:50.635007 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.634972    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:50.635106 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.635041    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:50.635106 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.635072    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:25:50.839909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:50.839860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:51.481999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:51.481961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerStarted","Data":"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"}
Sep 15 21:25:51.482331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:51.482017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerStarted","Data":"a4ebf6677fea58a9ea3ad77482c9276b07590284b7dfa9a1de7985e206f8d7c7"}
Sep 15 21:25:51.506904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:51.506855    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podStartSLOduration=1.5068402509999999 podStartE2EDuration="1.506840251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:51.506514302 +0000 UTC m=+947.114211414" watchObservedRunningTime="2026-09-15 21:25:51.506840251 +0000 UTC m=+947.114537338"
Sep 15 21:25:51.677310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:51.677278    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:52.206333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.206300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:25:52.343843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.343817    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:52.348621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.348596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:52.447310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.447281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:52.486625 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.486607    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:52.487502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.487483    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:25:52.988025 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:52.987998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:53.116158 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:53.116127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:53.471574 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:53.471537    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:54.187034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:54.187001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:54.951209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:54.951178    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:55.645767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:55.645737    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:56.370176 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:56.370150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.020220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.020191    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:25:57.023724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.023706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.025687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.025662    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ce9161fd-serving-cert\""
Sep 15 21:25:57.033394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.033359    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:25:57.047143 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.047123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.148597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.148565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.176000 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.175969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.176134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.176014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.176134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.176088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dptdn\" (UniqueName: \"kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.176134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.176122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.277370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.277301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.277370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.277341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.277370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.277362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dptdn\" (UniqueName: \"kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.277607 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:57.277457    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-serving-cert: secret "maas-api-e2e-derive-ce9161fd-serving-cert" not found
Sep 15 21:25:57.277607 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:25:57.277523    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls podName:95cf3028-99a0-4c1f-8462-6b814846948f nodeName:}" failed. No retries permitted until 2026-09-15 21:25:57.777503454 +0000 UTC m=+953.385200534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls") pod "maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" (UID: "95cf3028-99a0-4c1f-8462-6b814846948f") : secret "maas-api-e2e-derive-ce9161fd-serving-cert" not found
Sep 15 21:25:57.277607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.277465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.277875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.277857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.279723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.279705    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.285198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.285174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dptdn\" (UniqueName: \"kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.524873 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.524843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.629542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.629461    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.782266 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.782223    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.784656 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.784630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") pod \"maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:57.818713 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.818687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:25:57.936417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:57.936361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:58.205145 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:58.205067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:25:58.207851 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:25:58.207825    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cf3028_99a0_4c1f_8462_6b814846948f.slice/crio-958c3569e36f858a3abea4187f924bb0027febaa8451ab5d6a40bcd5a8efaa98 WatchSource:0}: Error finding container 958c3569e36f858a3abea4187f924bb0027febaa8451ab5d6a40bcd5a8efaa98: Status 404 returned error can't find the container with id 958c3569e36f858a3abea4187f924bb0027febaa8451ab5d6a40bcd5a8efaa98
Sep 15 21:25:58.512927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:58.512899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" event={"ID":"95cf3028-99a0-4c1f-8462-6b814846948f","Type":"ContainerStarted","Data":"958c3569e36f858a3abea4187f924bb0027febaa8451ab5d6a40bcd5a8efaa98"}
Sep 15 21:25:59.519313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:59.519276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" event={"ID":"95cf3028-99a0-4c1f-8462-6b814846948f","Type":"ContainerStarted","Data":"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"}
Sep 15 21:25:59.519769 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:59.519413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:25:59.538015 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:25:59.537968    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" podStartSLOduration=2.009233348 podStartE2EDuration="2.537940311s" totalImagesPullingTime="528.706963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:25:59.536027817 +0000 UTC m=+955.143724905" watchObservedRunningTime="2026-09-15 21:25:59.537940311 +0000 UTC m=+955.145637446"
Sep 15 21:26:01.551181 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:01.551150    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:05.530892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:05.530857    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:26:06.624920 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:06.624888    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:26:16.595884 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.595851    2558 generic.go:356] "Generic (PLEG): container finished" podID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerID="7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799" exitCode=0
Sep 15 21:26:16.596318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.595911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerDied","Data":"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"}
Sep 15 21:26:16.596318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.596241    2558 scope.go:117] "RemoveContainer" containerID="7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"
Sep 15 21:26:16.597320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.597288    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:16.597377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.597361    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:16.597411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:16.597392    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:26:17.601882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:17.601848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerStarted","Data":"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"}
Sep 15 21:26:17.922584 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:17.922499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:18.343837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:18.343800    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:18.344839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:18.344806    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 15 21:26:18.345102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:18.345069    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 15 21:26:19.344429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:19.344392    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 15 21:26:19.345018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:19.344984    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 15 21:26:19.499221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:19.499186    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:20.188185 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:20.188157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:20.343659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:20.343623    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 15 21:26:20.343856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:20.343706    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 15 21:26:20.396915 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:20.396882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:20.938613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:20.938573    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:21.344235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:21.344195    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 15 21:26:21.344446 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:21.344264    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 15 21:26:21.656431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:21.656339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:22.344259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:22.344214    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 15 21:26:22.344463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:22.344269    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 15 21:26:22.486912 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:22.486874    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:22.526100 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:22.526063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:23.310995 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:23.310940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:23.347256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:23.347223    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:23.348080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:23.348062    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:24.032354 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:24.032317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:24.726395 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:24.726365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:25.545544 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:25.545517    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:26.466830 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:26.466798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:27.167018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:27.166984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:27.934289 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:27.934247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:28.632763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:28.632730    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:29.322623 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:29.322591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:30.191207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:30.191166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:30.322273 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:30.322241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:30.945024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:30.944987    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:34.362230 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:34.362194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:34.984502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:34.984461    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:26:34.984735 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:34.984704    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" podUID="95cf3028-99a0-4c1f-8462-6b814846948f" containerName="maas-api" containerID="cri-o://72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c" gracePeriod=30
Sep 15 21:26:35.029278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.029227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.129853 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.129818    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.224621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.224599    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:26:35.231290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.231270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.299547 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.299473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.309672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.309648    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") pod \"95cf3028-99a0-4c1f-8462-6b814846948f\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") "
Sep 15 21:26:35.309781 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.309696    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dptdn\" (UniqueName: \"kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn\") pod \"95cf3028-99a0-4c1f-8462-6b814846948f\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") "
Sep 15 21:26:35.309781 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.309720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca\") pod \"95cf3028-99a0-4c1f-8462-6b814846948f\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") "
Sep 15 21:26:35.309781 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.309734    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs\") pod \"95cf3028-99a0-4c1f-8462-6b814846948f\" (UID: \"95cf3028-99a0-4c1f-8462-6b814846948f\") "
Sep 15 21:26:35.310026 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.310003    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95cf3028-99a0-4c1f-8462-6b814846948f" (UID: "95cf3028-99a0-4c1f-8462-6b814846948f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:35.311857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.311828    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "95cf3028-99a0-4c1f-8462-6b814846948f" (UID: "95cf3028-99a0-4c1f-8462-6b814846948f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:26:35.311857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.311844    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95cf3028-99a0-4c1f-8462-6b814846948f" (UID: "95cf3028-99a0-4c1f-8462-6b814846948f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:26:35.312006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.311940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn" (OuterVolumeSpecName: "kube-api-access-dptdn") pod "95cf3028-99a0-4c1f-8462-6b814846948f" (UID: "95cf3028-99a0-4c1f-8462-6b814846948f"). InnerVolumeSpecName "kube-api-access-dptdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:35.358234 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.358213    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.410852 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.410815    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:35.411272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.410882    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dptdn\" (UniqueName: \"kubernetes.io/projected/95cf3028-99a0-4c1f-8462-6b814846948f-kube-api-access-dptdn\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:35.411272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.410897    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95cf3028-99a0-4c1f-8462-6b814846948f-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:35.411272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.410909    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95cf3028-99a0-4c1f-8462-6b814846948f-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:35.436121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.436089    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:26:35.436316 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.436293    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" containerID="cri-o://53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614" gracePeriod=30
Sep 15 21:26:35.459202 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.459171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.627455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.627369    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:35.686265 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.686236    2558 generic.go:356] "Generic (PLEG): container finished" podID="95cf3028-99a0-4c1f-8462-6b814846948f" containerID="72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c" exitCode=0
Sep 15 21:26:35.686410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.686278    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"
Sep 15 21:26:35.686410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.686305    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" event={"ID":"95cf3028-99a0-4c1f-8462-6b814846948f","Type":"ContainerDied","Data":"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"}
Sep 15 21:26:35.686410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.686345    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s" event={"ID":"95cf3028-99a0-4c1f-8462-6b814846948f","Type":"ContainerDied","Data":"958c3569e36f858a3abea4187f924bb0027febaa8451ab5d6a40bcd5a8efaa98"}
Sep 15 21:26:35.686410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.686367    2558 scope.go:117] "RemoveContainer" containerID="72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"
Sep 15 21:26:35.696721 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.696703    2558 scope.go:117] "RemoveContainer" containerID="72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"
Sep 15 21:26:35.697111 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:26:35.697083    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c\": container with ID starting with 72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c not found: ID does not exist" containerID="72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"
Sep 15 21:26:35.697216 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.697119    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c"} err="failed to get container status \"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c\": rpc error: code = NotFound desc = could not find container \"72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c\": container with ID starting with 72bae24b600183b630e45eec54d58dea2833604f7f66c24ed28e6b8b3313282c not found: ID does not exist"
Sep 15 21:26:35.711727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.711705    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:26:35.717770 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:35.717748    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ce9161fd-677c675b76-6mb2s"]
Sep 15 21:26:36.169940 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.169910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.268996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.268931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.367309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.367285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.422527 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.422460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:26:36.589388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.589362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:36.961871 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:36.961840    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95cf3028-99a0-4c1f-8462-6b814846948f" path="/var/lib/kubelet/pods/95cf3028-99a0-4c1f-8462-6b814846948f/volumes"
Sep 15 21:26:37.453630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:37.453549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:37.764144 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:37.764108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:38.349910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:38.349877    2558 patch_prober.go:28] interesting pod/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 21:26:38.350099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:38.349936    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 21:26:38.562646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:38.562620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:39.313490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:39.313458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:40.127687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.127660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:40.686621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.686591    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:40.712904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.712881    2558 generic.go:356] "Generic (PLEG): container finished" podID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerID="53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614" exitCode=0
Sep 15 21:26:40.713064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.712980    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"
Sep 15 21:26:40.713064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.712983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerDied","Data":"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"}
Sep 15 21:26:40.713064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.713049    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58" event={"ID":"175d4633-45c3-4bdc-94f7-9a7978e9eb2a","Type":"ContainerDied","Data":"a4ebf6677fea58a9ea3ad77482c9276b07590284b7dfa9a1de7985e206f8d7c7"}
Sep 15 21:26:40.713208 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.713097    2558 scope.go:117] "RemoveContainer" containerID="53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"
Sep 15 21:26:40.721053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.721037    2558 scope.go:117] "RemoveContainer" containerID="7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"
Sep 15 21:26:40.728379 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.728361    2558 scope.go:117] "RemoveContainer" containerID="53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"
Sep 15 21:26:40.728684 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:26:40.728667    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614\": container with ID starting with 53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614 not found: ID does not exist" containerID="53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"
Sep 15 21:26:40.728727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.728694    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614"} err="failed to get container status \"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614\": rpc error: code = NotFound desc = could not find container \"53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614\": container with ID starting with 53eab8a965dccf022377009f7ecff20869e9a0c81e594151c21cf66d7cd09614 not found: ID does not exist"
Sep 15 21:26:40.728727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.728712    2558 scope.go:117] "RemoveContainer" containerID="7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"
Sep 15 21:26:40.729119 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:26:40.729095    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799\": container with ID starting with 7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799 not found: ID does not exist" containerID="7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"
Sep 15 21:26:40.729206 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.729123    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799"} err="failed to get container status \"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799\": rpc error: code = NotFound desc = could not find container \"7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799\": container with ID starting with 7aca45f8705259bb847ca04d36bc38ac56e826ec4964b4a6264050c5c9a42799 not found: ID does not exist"
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.757027    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.757325    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" podUID="7d573e49-8233-4518-8137-dc8ceb5d05da" containerName="maas-api" containerID="cri-o://fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98" gracePeriod=30
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758020    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758074    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758113    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js79d\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758244    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758279    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758353    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758398    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy\") pod \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\" (UID: \"175d4633-45c3-4bdc-94f7-9a7978e9eb2a\") "
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758729    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:40.759011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.758797    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.760479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.760453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:40.760479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.760469    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:40.760690 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.760656    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data" (OuterVolumeSpecName: "istio-data") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:40.765855 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.765825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:26:40.767302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.767268    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:26:40.767711 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.767685    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d" (OuterVolumeSpecName: "kube-api-access-js79d") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "kube-api-access-js79d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:40.767795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.767723    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token" (OuterVolumeSpecName: "istio-token") pod "175d4633-45c3-4bdc-94f7-9a7978e9eb2a" (UID: "175d4633-45c3-4bdc-94f7-9a7978e9eb2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:40.784258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.784222    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:40.859829 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859797    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.859829 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859832    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859849    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js79d\" (UniqueName: \"kubernetes.io/projected/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-kube-api-access-js79d\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859865    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859879    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859892    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859906    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860063 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.859919    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175d4633-45c3-4bdc-94f7-9a7978e9eb2a-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:40.860662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.860640    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:40.941575 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:40.941549    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.003307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.003285    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:26:41.043310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.043283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.043453 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.043401    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:26:41.047559 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.047526    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ce9161fd-openshift-default-96cd489d8-tkl58"]
Sep 15 21:26:41.060922 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.060898    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs\") pod \"7d573e49-8233-4518-8137-dc8ceb5d05da\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") "
Sep 15 21:26:41.061036 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.060934    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") pod \"7d573e49-8233-4518-8137-dc8ceb5d05da\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") "
Sep 15 21:26:41.061087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.061067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkncr\" (UniqueName: \"kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr\") pod \"7d573e49-8233-4518-8137-dc8ceb5d05da\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") "
Sep 15 21:26:41.061190 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.061174    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca\") pod \"7d573e49-8233-4518-8137-dc8ceb5d05da\" (UID: \"7d573e49-8233-4518-8137-dc8ceb5d05da\") "
Sep 15 21:26:41.061506 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.061485    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d573e49-8233-4518-8137-dc8ceb5d05da" (UID: "7d573e49-8233-4518-8137-dc8ceb5d05da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:26:41.062961 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.062927    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d573e49-8233-4518-8137-dc8ceb5d05da" (UID: "7d573e49-8233-4518-8137-dc8ceb5d05da"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:26:41.063041 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.062939    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr" (OuterVolumeSpecName: "kube-api-access-jkncr") pod "7d573e49-8233-4518-8137-dc8ceb5d05da" (UID: "7d573e49-8233-4518-8137-dc8ceb5d05da"). InnerVolumeSpecName "kube-api-access-jkncr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:26:41.063041 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.062943    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d573e49-8233-4518-8137-dc8ceb5d05da" (UID: "7d573e49-8233-4518-8137-dc8ceb5d05da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:26:41.108444 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.108419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.162244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.162212    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkncr\" (UniqueName: \"kubernetes.io/projected/7d573e49-8233-4518-8137-dc8ceb5d05da-kube-api-access-jkncr\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:41.162244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.162240    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d573e49-8233-4518-8137-dc8ceb5d05da-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:41.162615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.162253    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:41.162615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.162263    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d573e49-8233-4518-8137-dc8ceb5d05da-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:26:41.455227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.455163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:41.718997 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.718963    2558 generic.go:356] "Generic (PLEG): container finished" podID="7d573e49-8233-4518-8137-dc8ceb5d05da" containerID="fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98" exitCode=0
Sep 15 21:26:41.719177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.719009    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"
Sep 15 21:26:41.719177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.719048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" event={"ID":"7d573e49-8233-4518-8137-dc8ceb5d05da","Type":"ContainerDied","Data":"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"}
Sep 15 21:26:41.719177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.719108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5" event={"ID":"7d573e49-8233-4518-8137-dc8ceb5d05da","Type":"ContainerDied","Data":"788bff57ace88122f1f8ce8e1dd1add98118d82483bf3153692413d4e3815200"}
Sep 15 21:26:41.719177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.719137    2558 scope.go:117] "RemoveContainer" containerID="fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"
Sep 15 21:26:41.727828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.727812    2558 scope.go:117] "RemoveContainer" containerID="fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"
Sep 15 21:26:41.728087 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:26:41.728072    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98\": container with ID starting with fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98 not found: ID does not exist" containerID="fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"
Sep 15 21:26:41.728154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.728097    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98"} err="failed to get container status \"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98\": rpc error: code = NotFound desc = could not find container \"fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98\": container with ID starting with fb9f5a83b070c01fea8c8cf09c0a1c1921dc16789e09b34ac979851ed51a3e98 not found: ID does not exist"
Sep 15 21:26:41.740270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.740247    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:26:41.745543 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.745523    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-04c28d-748849f6db-hn9b5"]
Sep 15 21:26:41.937168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:41.937140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:42.710834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:42.710803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:42.962405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:42.962377    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" path="/var/lib/kubelet/pods/175d4633-45c3-4bdc-94f7-9a7978e9eb2a/volumes"
Sep 15 21:26:42.962754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:42.962742    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d573e49-8233-4518-8137-dc8ceb5d05da" path="/var/lib/kubelet/pods/7d573e49-8233-4518-8137-dc8ceb5d05da/volumes"
Sep 15 21:26:43.578106 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:43.578075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.336581 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:44.336553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.752287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:44.752257    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.854873 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:44.854843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:44.956633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:44.956599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:45.054604 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:45.054534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:45.518231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:45.518205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:46.542981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:46.542930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:26:56.808299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:26:56.808267    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:27:01.301860 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:01.301824    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:11.441257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:11.441229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:15.972456 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:15.972399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:17.373361 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:17.373314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:17.479507 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:17.479469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:17.576577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:17.576548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:23.553793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:23.553761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:23.792075 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:23.792036    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:27:23.792306 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:23.792267    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy" containerID="cri-o://8a8aaf6fa35e46514b6fe7dd951ece74edd959de163b96eaf817cfff52e06fc4" gracePeriod=30
Sep 15 21:27:23.828177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:23.828097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:24.251921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:24.251888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:24.556761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:24.556673    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:24.677532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:24.677502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:27.639802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:27.639770    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:27.779686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:27.779647    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:27.878631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:27.878591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:28.453287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:28.453233    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:28.925597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:28.925569    2558 generic.go:356] "Generic (PLEG): container finished" podID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerID="8a8aaf6fa35e46514b6fe7dd951ece74edd959de163b96eaf817cfff52e06fc4" exitCode=0
Sep 15 21:27:28.925935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:28.925637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerDied","Data":"8a8aaf6fa35e46514b6fe7dd951ece74edd959de163b96eaf817cfff52e06fc4"}
Sep 15 21:27:28.925935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:28.925719    2558 scope.go:117] "RemoveContainer" containerID="4a56be4bc681f6a330f90d9e53d94a74184cd822076783db37ef04a372981abb"
Sep 15 21:27:29.038657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.038636    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:27:29.125967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.125890    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.125967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.125962    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.125993    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126021    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nq4g\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126068    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126102    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126167    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126234    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:29.126397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126312    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy\") pod \"cf7f60b0-63bc-4509-8620-af9b5243ec12\" (UID: \"cf7f60b0-63bc-4509-8620-af9b5243ec12\") "
Sep 15 21:27:29.126397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:29.126397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126339    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:29.126645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126486    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:29.126645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126597    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:27:29.126645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126613    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.126645 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126634    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.126791 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126648    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.126791 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.126662    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.128336 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.128307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g" (OuterVolumeSpecName: "kube-api-access-7nq4g") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "kube-api-access-7nq4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:27:29.128431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.128307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:27:29.128573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.128548    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:27:29.128573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.128556    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf7f60b0-63bc-4509-8620-af9b5243ec12" (UID: "cf7f60b0-63bc-4509-8620-af9b5243ec12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:27:29.227328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.227294    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.227328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.227325    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.227328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.227333    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf7f60b0-63bc-4509-8620-af9b5243ec12-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.227482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.227342    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nq4g\" (UniqueName: \"kubernetes.io/projected/cf7f60b0-63bc-4509-8620-af9b5243ec12-kube-api-access-7nq4g\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.227482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.227350    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf7f60b0-63bc-4509-8620-af9b5243ec12-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:27:29.353134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.353104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:29.931429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.931403    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"
Sep 15 21:27:29.931429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.931421    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh" event={"ID":"cf7f60b0-63bc-4509-8620-af9b5243ec12","Type":"ContainerDied","Data":"c4ae24a1a41166b66db42f708771ed756f232ec7aeea53b6fa62dd464e0db74f"}
Sep 15 21:27:29.931892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.931472    2558 scope.go:117] "RemoveContainer" containerID="8a8aaf6fa35e46514b6fe7dd951ece74edd959de163b96eaf817cfff52e06fc4"
Sep 15 21:27:29.953330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.953303    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:27:29.959603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:29.959583    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-04c28d-openshift-default-5d7bd76c9b-g6vxh"]
Sep 15 21:27:30.037040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.037018    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:30.708246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708212    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:27:30.708553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708540    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708554    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708569    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cf3028-99a0-4c1f-8462-6b814846948f" containerName="maas-api"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708574    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cf3028-99a0-4c1f-8462-6b814846948f" containerName="maas-api"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708581    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708586    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708595    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708601    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708613    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d573e49-8233-4518-8137-dc8ceb5d05da" containerName="maas-api"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708619    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d573e49-8233-4518-8137-dc8ceb5d05da" containerName="maas-api"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708624    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708629    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708675    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cf3028-99a0-4c1f-8462-6b814846948f" containerName="maas-api"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708685    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708693    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708698    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708703    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="175d4633-45c3-4bdc-94f7-9a7978e9eb2a" containerName="istio-proxy"
Sep 15 21:27:30.708803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.708710    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d573e49-8233-4518-8137-dc8ceb5d05da" containerName="maas-api"
Sep 15 21:27:30.712986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.712965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.714955 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.714925    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-026d11-serving-cert\""
Sep 15 21:27:30.719610 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.719577    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:27:30.739030 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.739006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.739121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.739039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.739121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.739084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.739121 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.739102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d285\" (UniqueName: \"kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.741624 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.741603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:30.839882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.839851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.840024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.839887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d285\" (UniqueName: \"kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.840024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.839932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.840024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.839966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.840024 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:27:30.840011    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-serving-cert: secret "maas-api-e2e-explicit-026d11-serving-cert" not found
Sep 15 21:27:30.840162 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:27:30.840091    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls podName:e6937ea0-f1a5-44b0-ab0b-2db0a7881221 nodeName:}" failed. No retries permitted until 2026-09-15 21:27:31.340066356 +0000 UTC m=+1046.947763423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls") pod "maas-api-e2e-explicit-026d11-5796b45586-smfb7" (UID: "e6937ea0-f1a5-44b0-ab0b-2db0a7881221") : secret "maas-api-e2e-explicit-026d11-serving-cert" not found
Sep 15 21:27:30.840676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.840655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.842259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.842240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.843875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.843855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:30.848122 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.848098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d285\" (UniqueName: \"kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:30.961539 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:30.961483    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7f60b0-63bc-4509-8620-af9b5243ec12" path="/var/lib/kubelet/pods/cf7f60b0-63bc-4509-8620-af9b5243ec12/volumes"
Sep 15 21:27:31.311171 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.311096    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:27:31.314494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.314480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.316435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.316415    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-026d11\""
Sep 15 21:27:31.325012 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.324993    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:27:31.343163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.343135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:31.343278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.343175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rmq\" (UniqueName: \"kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.343341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.343291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.345447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.345420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") pod \"maas-api-e2e-explicit-026d11-5796b45586-smfb7\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:31.383916 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.383893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:31.444044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.444017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rmq\" (UniqueName: \"kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.444214 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.444194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.444813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.444794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.451981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.451938    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rmq\" (UniqueName: \"kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq\") pod \"payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.478210 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.478183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:31.624277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.624221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:31.624362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.624323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:31.902372 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.902296    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:27:31.904304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.904263    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:27:31.905244 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:27:31.905222    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763fc743_254e_42d4_aa3e_7d301e6651c4.slice/crio-3f0d1b7487a534e9a70d27917b7b95f2f7fc43500668d64a31ac3f05ec42c028 WatchSource:0}: Error finding container 3f0d1b7487a534e9a70d27917b7b95f2f7fc43500668d64a31ac3f05ec42c028: Status 404 returned error can't find the container with id 3f0d1b7487a534e9a70d27917b7b95f2f7fc43500668d64a31ac3f05ec42c028
Sep 15 21:27:31.906968 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:27:31.906935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6937ea0_f1a5_44b0_ab0b_2db0a7881221.slice/crio-afa4f3ccdbac1c1b6a5d81f3a61f16384866d57d8a762bbd812041952b77410a WatchSource:0}: Error finding container afa4f3ccdbac1c1b6a5d81f3a61f16384866d57d8a762bbd812041952b77410a: Status 404 returned error can't find the container with id afa4f3ccdbac1c1b6a5d81f3a61f16384866d57d8a762bbd812041952b77410a
Sep 15 21:27:31.908694 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.908678    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:27:31.941179 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.941156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" event={"ID":"e6937ea0-f1a5-44b0-ab0b-2db0a7881221","Type":"ContainerStarted","Data":"afa4f3ccdbac1c1b6a5d81f3a61f16384866d57d8a762bbd812041952b77410a"}
Sep 15 21:27:31.942646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:31.942620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" event={"ID":"763fc743-254e-42d4-aa3e-7d301e6651c4","Type":"ContainerStarted","Data":"3f0d1b7487a534e9a70d27917b7b95f2f7fc43500668d64a31ac3f05ec42c028"}
Sep 15 21:27:32.949218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.949120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" event={"ID":"e6937ea0-f1a5-44b0-ab0b-2db0a7881221","Type":"ContainerStarted","Data":"cdeda6c5a6b8fbcab2a43ff8ef46ebfa5762e75c2d191eaf4bd7b9626fd62a0b"}
Sep 15 21:27:32.949630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.949241    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:32.950702 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.950672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" event={"ID":"763fc743-254e-42d4-aa3e-7d301e6651c4","Type":"ContainerStarted","Data":"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"}
Sep 15 21:27:32.950802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.950764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:32.969069 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.969027    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" podStartSLOduration=2.386353922 podStartE2EDuration="2.969014046s" totalImagesPullingTime="582.660124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:32.967538298 +0000 UTC m=+1048.575235386" watchObservedRunningTime="2026-09-15 21:27:32.969014046 +0000 UTC m=+1048.576711171"
Sep 15 21:27:32.983893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:32.983845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" podStartSLOduration=1.983829456 podStartE2EDuration="1.983829456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:27:32.981782295 +0000 UTC m=+1048.589479382" watchObservedRunningTime="2026-09-15 21:27:32.983829456 +0000 UTC m=+1048.591526546"
Sep 15 21:27:33.525220 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:33.525161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:34.253600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:34.253569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:38.962603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:38.962579    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:27:39.435684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:39.435599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:39.540988 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:39.540936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:39.640574 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:39.640543    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:41.508626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:41.508589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:27:43.956851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:43.956812    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:27:50.151671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:50.151635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:50.937991 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:50.937930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:52.693714 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:52.693668    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:52.832335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:52.832298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:53.641495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:53.641458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:54.318921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:54.318893    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:55.144410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:55.144379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:55.842569 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:55.842539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:56.639197 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:56.639168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:57.252361 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:57.252329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:57.360999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:57.360965    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:57.452630 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:57.452599    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:57.553188 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:57.553099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:58.195289 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:58.195256    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:58.290729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:58.290689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:58.394313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:58.394290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:27:59.850636 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:27:59.850603    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:04.532431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:04.532397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:05.208714 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:05.208688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:28:05.735136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:05.735110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:05.835931 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:05.835900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:06.395605 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:06.395569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.272276 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.272244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.331101 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.331072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.507404 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.507371    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.777504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.777476    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:28:12.782130 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.782109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.784175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.784154    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-af7b8de1-openshift-default-dockercfg-k4cgl\""
Sep 15 21:28:12.794172 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.794148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:28:12.809432 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.809408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:12.956799 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.956766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.956799 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.956804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnr7\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.956829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.956970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.957019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.957043    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957275 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.957117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957275 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.957159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:12.957275 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:12.957183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.028696 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.028627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:13.057740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnr7\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.057836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057749    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.057836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.057836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.057910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058449    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.058552 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.058523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.060269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.060249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.060354 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.060295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.066205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.066175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.067003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.066979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnr7\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7\") pod \"e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") " pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.093195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.093158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:13.449061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.449033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:28:13.451629 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:28:13.451603    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd02d4f8_eaaa_4794_8f7a_f442f9a77bab.slice/crio-5c707da98bfaa055c94d3f812caa3bb754a091287c5f0212235c66b002c1b1b7 WatchSource:0}: Error finding container 5c707da98bfaa055c94d3f812caa3bb754a091287c5f0212235c66b002c1b1b7: Status 404 returned error can't find the container with id 5c707da98bfaa055c94d3f812caa3bb754a091287c5f0212235c66b002c1b1b7
Sep 15 21:28:13.453901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.453860    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:13.454008 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.453974    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:13.454052 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:13.454020    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:14.045037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:14.045008    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:14.130228 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:14.130194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerStarted","Data":"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"}
Sep 15 21:28:14.130371 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:14.130243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerStarted","Data":"5c707da98bfaa055c94d3f812caa3bb754a091287c5f0212235c66b002c1b1b7"}
Sep 15 21:28:14.153720 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:14.153675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podStartSLOduration=2.153660505 podStartE2EDuration="2.153660505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:14.151971692 +0000 UTC m=+1089.759668781" watchObservedRunningTime="2026-09-15 21:28:14.153660505 +0000 UTC m=+1089.761357593"
Sep 15 21:28:15.093812 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:15.093777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:15.098607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:15.098585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:15.134466 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:15.134443    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:15.135102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:15.135085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:18.380541 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:18.380514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:18.562708 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:18.562677    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:18.667984 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:18.667899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:19.227707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:19.227677    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:19.915576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:19.915546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:20.143168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:20.143141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:20.839929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:20.839875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:21.518307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:21.518276    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:28:21.633505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:21.633477    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:22.345626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.345583    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:28:22.349545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.349518    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.351537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.351514    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-af7b8de1-serving-cert\""
Sep 15 21:28:22.358858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.358830    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:28:22.381586 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.381564    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:22.483525 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.483491    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:22.531706 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.531676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6g5\" (UniqueName: \"kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.532076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.531709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.532076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.531784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.532076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.531826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.586235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.586208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:22.632774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.632715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.632774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.632757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.632972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.632781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6g5\" (UniqueName: \"kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.632972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.632799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.633383 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.633366    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.635102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.635083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.635232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.635212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.640868 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.640850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6g5\" (UniqueName: \"kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5\") pod \"maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.661896 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.661871    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:22.941226 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.941203    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:28:22.943253 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:28:22.943224    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df3a00b_d60d_4fc5_aa79_d0b645eba62f.slice/crio-869186343cd7400d5e21ca425a2ae3555566583d19363a39837b4cf40cbfd476 WatchSource:0}: Error finding container 869186343cd7400d5e21ca425a2ae3555566583d19363a39837b4cf40cbfd476: Status 404 returned error can't find the container with id 869186343cd7400d5e21ca425a2ae3555566583d19363a39837b4cf40cbfd476
Sep 15 21:28:22.954153 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:22.954127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:23.050973 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.050924    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:23.092530 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.092504    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:28:23.096960 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.096930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.099588 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.099566    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-af7b8de1\""
Sep 15 21:28:23.099672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.099604    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-af7b8de1-dockercfg-wzhnl\""
Sep 15 21:28:23.106983 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.106961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:28:23.169903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.169874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" event={"ID":"8df3a00b-d60d-4fc5-aa79-d0b645eba62f","Type":"ContainerStarted","Data":"869186343cd7400d5e21ca425a2ae3555566583d19363a39837b4cf40cbfd476"}
Sep 15 21:28:23.238403 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.238364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.238553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.238475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8kz\" (UniqueName: \"kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.338865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.338840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8kz\" (UniqueName: \"kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.339031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.338898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.339520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.339504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.347016 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.346990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8kz\" (UniqueName: \"kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz\") pod \"payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") " pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.407712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.407688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:23.676491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:23.676397    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:28:23.678820 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:28:23.678790    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c6b664_0f67_48ee_9617_f9a15a956d36.slice/crio-6f394d0911d2146fc9444beef2e9ed551627a5d007135da0cf9a747a55fe3612 WatchSource:0}: Error finding container 6f394d0911d2146fc9444beef2e9ed551627a5d007135da0cf9a747a55fe3612: Status 404 returned error can't find the container with id 6f394d0911d2146fc9444beef2e9ed551627a5d007135da0cf9a747a55fe3612
Sep 15 21:28:24.176555 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:24.176522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" event={"ID":"79c6b664-0f67-48ee-9617-f9a15a956d36","Type":"ContainerStarted","Data":"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"}
Sep 15 21:28:24.176725 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:24.176572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" event={"ID":"79c6b664-0f67-48ee-9617-f9a15a956d36","Type":"ContainerStarted","Data":"6f394d0911d2146fc9444beef2e9ed551627a5d007135da0cf9a747a55fe3612"}
Sep 15 21:28:24.176725 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:24.176635    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:24.192745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:24.192701    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" podStartSLOduration=1.192687871 podStartE2EDuration="1.192687871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:24.191684096 +0000 UTC m=+1099.799381184" watchObservedRunningTime="2026-09-15 21:28:24.192687871 +0000 UTC m=+1099.800384959"
Sep 15 21:28:25.181903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:25.181870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" event={"ID":"8df3a00b-d60d-4fc5-aa79-d0b645eba62f","Type":"ContainerStarted","Data":"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"}
Sep 15 21:28:25.182386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:25.181989    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:25.200368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:25.200321    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" podStartSLOduration=1.8348338960000001 podStartE2EDuration="3.200307689s" totalImagesPullingTime="1.365473793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:28:25.19833017 +0000 UTC m=+1100.806027268" watchObservedRunningTime="2026-09-15 21:28:25.200307689 +0000 UTC m=+1100.808004822"
Sep 15 21:28:31.192459 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:31.192428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:28:35.184138 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:35.184107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:28:38.005968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:38.005925    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:41.006100 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:41.006060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:28:42.281541 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.281506    2558 generic.go:356] "Generic (PLEG): container finished" podID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerID="f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce" exitCode=0
Sep 15 21:28:42.281999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.281556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerDied","Data":"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"}
Sep 15 21:28:42.281999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.281925    2558 scope.go:117] "RemoveContainer" containerID="f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"
Sep 15 21:28:42.283036 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.283005    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:42.283146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.283089    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:42.283146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:42.283138    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:28:43.288212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:43.288175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerStarted","Data":"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"}
Sep 15 21:28:44.094370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:44.094335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:44.095441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:44.095419    2558 patch_prober.go:28] interesting pod/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 21:28:44.095510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:44.095492    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 21:28:44.429456 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:44.429377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:45.094454 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:45.094416    2558 patch_prober.go:28] interesting pod/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 21:28:45.094626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:45.094474    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 21:28:45.134698 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:45.134665    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:45.359700 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:45.359605    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:45.456664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:45.456632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:46.091746 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:46.091716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:46.093826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:46.093803    2558 patch_prober.go:28] interesting pod/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 21:28:46.093885 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:46.093853    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 21:28:47.094268 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:47.094230    2558 patch_prober.go:28] interesting pod/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 21:28:47.094707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:47.094288    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 21:28:47.800318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:47.800286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:47.898853 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:47.898821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:48.093651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:48.093558    2558 patch_prober.go:28] interesting pod/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 15 21:28:48.093651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:48.093612    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 15 21:28:48.525157 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:48.525128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:48.666162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:48.666130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:49.098181 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:49.098155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:49.098924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:49.098903    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:28:49.299943 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:49.299912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:50.178778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:50.178746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:50.280126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:50.280098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:51.652439 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:51.652407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:55.646298 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:55.646268    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:55.707570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:55.707542    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:57.009132 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:57.009104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:57.675743 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:57.675714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:58.373710 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:58.373676    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:59.064662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:59.064628    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:28:59.780213 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:28:59.780181    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:00.536679 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:00.536650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:01.258395 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:01.258362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.443397 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.443363    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:29:06.443869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.443565    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" podUID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" containerName="maas-api" containerID="cri-o://0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc" gracePeriod=30
Sep 15 21:29:06.474550 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.474525    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.498859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.498832    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:29:06.499092 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.499048    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" podUID="79c6b664-0f67-48ee-9617-f9a15a956d36" containerName="payload-processing" containerID="cri-o://69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3" gracePeriod=30
Sep 15 21:29:06.574479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.574447    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.679616 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.679586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.741309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.741284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:06.746625 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.746607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:29:06.775223 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.775199    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:29:06.939304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d6g5\" (UniqueName: \"kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5\") pod \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") "
Sep 15 21:29:06.939486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939322    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume\") pod \"79c6b664-0f67-48ee-9617-f9a15a956d36\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") "
Sep 15 21:29:06.939486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl8kz\" (UniqueName: \"kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz\") pod \"79c6b664-0f67-48ee-9617-f9a15a956d36\" (UID: \"79c6b664-0f67-48ee-9617-f9a15a956d36\") "
Sep 15 21:29:06.939486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939367    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls\") pod \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") "
Sep 15 21:29:06.939486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs\") pod \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") "
Sep 15 21:29:06.939486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca\") pod \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\" (UID: \"8df3a00b-d60d-4fc5-aa79-d0b645eba62f\") "
Sep 15 21:29:06.939870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939843    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8df3a00b-d60d-4fc5-aa79-d0b645eba62f" (UID: "8df3a00b-d60d-4fc5-aa79-d0b645eba62f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:06.939979 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.939840    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "79c6b664-0f67-48ee-9617-f9a15a956d36" (UID: "79c6b664-0f67-48ee-9617-f9a15a956d36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:06.941417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.941393    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8df3a00b-d60d-4fc5-aa79-d0b645eba62f" (UID: "8df3a00b-d60d-4fc5-aa79-d0b645eba62f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:29:06.941507 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.941462    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz" (OuterVolumeSpecName: "kube-api-access-cl8kz") pod "79c6b664-0f67-48ee-9617-f9a15a956d36" (UID: "79c6b664-0f67-48ee-9617-f9a15a956d36"). InnerVolumeSpecName "kube-api-access-cl8kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:06.941733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.941715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5" (OuterVolumeSpecName: "kube-api-access-7d6g5") pod "8df3a00b-d60d-4fc5-aa79-d0b645eba62f" (UID: "8df3a00b-d60d-4fc5-aa79-d0b645eba62f"). InnerVolumeSpecName "kube-api-access-7d6g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:06.941793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:06.941724    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8df3a00b-d60d-4fc5-aa79-d0b645eba62f" (UID: "8df3a00b-d60d-4fc5-aa79-d0b645eba62f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:29:07.040155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040129    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040151    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d6g5\" (UniqueName: \"kubernetes.io/projected/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-kube-api-access-7d6g5\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040164    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79c6b664-0f67-48ee-9617-f9a15a956d36-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040177    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl8kz\" (UniqueName: \"kubernetes.io/projected/79c6b664-0f67-48ee-9617-f9a15a956d36-kube-api-access-cl8kz\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040187    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040195    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df3a00b-d60d-4fc5-aa79-d0b645eba62f-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:07.040814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.040797    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:07.141357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.141333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:07.394924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.394838    2558 generic.go:356] "Generic (PLEG): container finished" podID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" containerID="0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc" exitCode=0
Sep 15 21:29:07.394924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.394881    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"
Sep 15 21:29:07.395154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.394928    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" event={"ID":"8df3a00b-d60d-4fc5-aa79-d0b645eba62f","Type":"ContainerDied","Data":"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"}
Sep 15 21:29:07.395154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.395002    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x" event={"ID":"8df3a00b-d60d-4fc5-aa79-d0b645eba62f","Type":"ContainerDied","Data":"869186343cd7400d5e21ca425a2ae3555566583d19363a39837b4cf40cbfd476"}
Sep 15 21:29:07.395154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.395033    2558 scope.go:117] "RemoveContainer" containerID="0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"
Sep 15 21:29:07.396259 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.396238    2558 generic.go:356] "Generic (PLEG): container finished" podID="79c6b664-0f67-48ee-9617-f9a15a956d36" containerID="69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3" exitCode=0
Sep 15 21:29:07.396353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.396282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" event={"ID":"79c6b664-0f67-48ee-9617-f9a15a956d36","Type":"ContainerDied","Data":"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"}
Sep 15 21:29:07.396353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.396322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx" event={"ID":"79c6b664-0f67-48ee-9617-f9a15a956d36","Type":"ContainerDied","Data":"6f394d0911d2146fc9444beef2e9ed551627a5d007135da0cf9a747a55fe3612"}
Sep 15 21:29:07.396353 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.396343    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"
Sep 15 21:29:07.403609 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.403593    2558 scope.go:117] "RemoveContainer" containerID="0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"
Sep 15 21:29:07.403905 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:07.403881    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc\": container with ID starting with 0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc not found: ID does not exist" containerID="0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"
Sep 15 21:29:07.404024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.403913    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc"} err="failed to get container status \"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc\": rpc error: code = NotFound desc = could not find container \"0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc\": container with ID starting with 0943b69f3818b5236d728421cff4b449a71855763967b0be651ebb7b15300bdc not found: ID does not exist"
Sep 15 21:29:07.404024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.403934    2558 scope.go:117] "RemoveContainer" containerID="69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"
Sep 15 21:29:07.411099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.411083    2558 scope.go:117] "RemoveContainer" containerID="69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"
Sep 15 21:29:07.411330 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:07.411316    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3\": container with ID starting with 69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3 not found: ID does not exist" containerID="69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"
Sep 15 21:29:07.411386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.411335    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3"} err="failed to get container status \"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3\": rpc error: code = NotFound desc = could not find container \"69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3\": container with ID starting with 69c95f415886687207048e14335c40f740344f64a5a4eacdcc70444e311f6ee3 not found: ID does not exist"
Sep 15 21:29:07.416882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.416862    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:29:07.420550 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.420530    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-af7b8de1-56b85f669-frdbx"]
Sep 15 21:29:07.432809 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.432788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:29:07.436608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.436590    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-af7b8de1-758d9596cc-qlb5x"]
Sep 15 21:29:07.867161 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:07.867131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:08.746981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:08.746933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:08.962024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:08.961990    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c6b664-0f67-48ee-9617-f9a15a956d36" path="/var/lib/kubelet/pods/79c6b664-0f67-48ee-9617-f9a15a956d36/volumes"
Sep 15 21:29:08.962418 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:08.962402    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" path="/var/lib/kubelet/pods/8df3a00b-d60d-4fc5-aa79-d0b645eba62f/volumes"
Sep 15 21:29:09.432756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:09.432727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:09.805084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:09.805050    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:29:10.238662 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:10.238632    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:10.929606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:10.929578    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:12.644560 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:12.644532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.013229 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.013196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.234707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.234678    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.340570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.340498    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.471285 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.471255    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:29:13.471524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.471500    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy" containerID="cri-o://884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4" gracePeriod=30
Sep 15 21:29:13.493849 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.493820    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:13.740577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:13.740550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:14.882376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:14.882328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:14.938414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:14.938387    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:15.489142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:15.489110    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:16.349412 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:16.349383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:17.042147 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:17.042116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:17.730440 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:17.730411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:18.711915 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.711894    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:29:18.728501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728483    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728552    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728586    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728755 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728603    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728755 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728653    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728755 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728693    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcnr7\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728755 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728717    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.728755 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:18.729039 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728740    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo\") pod \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\" (UID: \"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab\") "
Sep 15 21:29:18.729039 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.728796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:18.729207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.729113    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.729207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.729133    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.729207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.729141    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:18.729351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.729220    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:18.729351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.729274    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:18.730774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.730743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:29:18.731475 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.730803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7" (OuterVolumeSpecName: "kube-api-access-wcnr7") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "kube-api-access-wcnr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:18.731475 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.731053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:29:18.731634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.731499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" (UID: "dd02d4f8-eaaa-4794-8f7a-f442f9a77bab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830129    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830163    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcnr7\" (UniqueName: \"kubernetes.io/projected/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-kube-api-access-wcnr7\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830173    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830182    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830190    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830197    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:18.830195 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:18.830205    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:19.449593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.449556    2558 generic.go:356] "Generic (PLEG): container finished" podID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerID="884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4" exitCode=0
Sep 15 21:29:19.449749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.449615    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerDied","Data":"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"}
Sep 15 21:29:19.449749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.449623    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"
Sep 15 21:29:19.449749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.449667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj" event={"ID":"dd02d4f8-eaaa-4794-8f7a-f442f9a77bab","Type":"ContainerDied","Data":"5c707da98bfaa055c94d3f812caa3bb754a091287c5f0212235c66b002c1b1b7"}
Sep 15 21:29:19.449749 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.449697    2558 scope.go:117] "RemoveContainer" containerID="884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"
Sep 15 21:29:19.457704 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.457687    2558 scope.go:117] "RemoveContainer" containerID="f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"
Sep 15 21:29:19.464910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.464893    2558 scope.go:117] "RemoveContainer" containerID="884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"
Sep 15 21:29:19.465205 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:19.465187    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4\": container with ID starting with 884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4 not found: ID does not exist" containerID="884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"
Sep 15 21:29:19.465250 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.465213    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4"} err="failed to get container status \"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4\": rpc error: code = NotFound desc = could not find container \"884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4\": container with ID starting with 884fb3d956528f394308f22de175e1aa1c864cd98de57fc0d7beb3c940c0a4d4 not found: ID does not exist"
Sep 15 21:29:19.465250 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.465230    2558 scope.go:117] "RemoveContainer" containerID="f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"
Sep 15 21:29:19.465459 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:19.465441    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce\": container with ID starting with f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce not found: ID does not exist" containerID="f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"
Sep 15 21:29:19.465494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.465466    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce"} err="failed to get container status \"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce\": rpc error: code = NotFound desc = could not find container \"f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce\": container with ID starting with f367da48912fb2071f51424fb0d4a81649e540def299c460f69f0502f6dfd2ce not found: ID does not exist"
Sep 15 21:29:19.469536 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.469511    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:29:19.471367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:19.471343    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-af7b8de1-openshift-default-8c4f944cb-2x2zj"]
Sep 15 21:29:20.789763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:20.789735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:20.842773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:20.842745    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:20.962745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:20.962716    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" path="/var/lib/kubelet/pods/dd02d4f8-eaaa-4794-8f7a-f442f9a77bab/volumes"
Sep 15 21:29:21.135099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:21.135025    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:22.949816 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:22.949786    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:23.745657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:23.745631    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.327553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.327521    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:29:24.327989 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.327728    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" podUID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" containerName="maas-api" containerID="cri-o://cdeda6c5a6b8fbcab2a43ff8ef46ebfa5762e75c2d191eaf4bd7b9626fd62a0b" gracePeriod=30
Sep 15 21:29:24.360806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.360783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.386523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.386491    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:29:24.386790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.386738    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" podUID="763fc743-254e-42d4-aa3e-7d301e6651c4" containerName="payload-pre-processing" containerID="cri-o://77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac" gracePeriod=30
Sep 15 21:29:24.461194 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.461166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.473209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.473185    2558 generic.go:356] "Generic (PLEG): container finished" podID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" containerID="cdeda6c5a6b8fbcab2a43ff8ef46ebfa5762e75c2d191eaf4bd7b9626fd62a0b" exitCode=0
Sep 15 21:29:24.473325 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.473220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" event={"ID":"e6937ea0-f1a5-44b0-ab0b-2db0a7881221","Type":"ContainerDied","Data":"cdeda6c5a6b8fbcab2a43ff8ef46ebfa5762e75c2d191eaf4bd7b9626fd62a0b"}
Sep 15 21:29:24.561866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.561831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.617719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.617696    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:29:24.641378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.641338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.643424 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.643405    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:29:24.672118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672093    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6rmq\" (UniqueName: \"kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq\") pod \"763fc743-254e-42d4-aa3e-7d301e6651c4\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") "
Sep 15 21:29:24.672235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672144    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs\") pod \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") "
Sep 15 21:29:24.672235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d285\" (UniqueName: \"kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285\") pod \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") "
Sep 15 21:29:24.672349 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672256    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") pod \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") "
Sep 15 21:29:24.672349 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672291    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume\") pod \"763fc743-254e-42d4-aa3e-7d301e6651c4\" (UID: \"763fc743-254e-42d4-aa3e-7d301e6651c4\") "
Sep 15 21:29:24.672349 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672330    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca\") pod \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\" (UID: \"e6937ea0-f1a5-44b0-ab0b-2db0a7881221\") "
Sep 15 21:29:24.672840 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672706    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "763fc743-254e-42d4-aa3e-7d301e6651c4" (UID: "763fc743-254e-42d4-aa3e-7d301e6651c4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:24.672977 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.672863    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6937ea0-f1a5-44b0-ab0b-2db0a7881221" (UID: "e6937ea0-f1a5-44b0-ab0b-2db0a7881221"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:29:24.674208 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.674177    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq" (OuterVolumeSpecName: "kube-api-access-d6rmq") pod "763fc743-254e-42d4-aa3e-7d301e6651c4" (UID: "763fc743-254e-42d4-aa3e-7d301e6651c4"). InnerVolumeSpecName "kube-api-access-d6rmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:24.674309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.674214    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6937ea0-f1a5-44b0-ab0b-2db0a7881221" (UID: "e6937ea0-f1a5-44b0-ab0b-2db0a7881221"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:29:24.674579 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.674559    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285" (OuterVolumeSpecName: "kube-api-access-9d285") pod "e6937ea0-f1a5-44b0-ab0b-2db0a7881221" (UID: "e6937ea0-f1a5-44b0-ab0b-2db0a7881221"). InnerVolumeSpecName "kube-api-access-9d285". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:29:24.674579 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.674557    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6937ea0-f1a5-44b0-ab0b-2db0a7881221" (UID: "e6937ea0-f1a5-44b0-ab0b-2db0a7881221"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:29:24.699258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.699234    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:24.773388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773357    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d285\" (UniqueName: \"kubernetes.io/projected/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-kube-api-access-9d285\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.773388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773381    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.773388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773394    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/763fc743-254e-42d4-aa3e-7d301e6651c4-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.773611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773404    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.773611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773412    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6rmq\" (UniqueName: \"kubernetes.io/projected/763fc743-254e-42d4-aa3e-7d301e6651c4-kube-api-access-d6rmq\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.773611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.773420    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6937ea0-f1a5-44b0-ab0b-2db0a7881221-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:29:24.960346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:24.960317    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:25.478631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.478604    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"
Sep 15 21:29:25.479045 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.478604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7" event={"ID":"e6937ea0-f1a5-44b0-ab0b-2db0a7881221","Type":"ContainerDied","Data":"afa4f3ccdbac1c1b6a5d81f3a61f16384866d57d8a762bbd812041952b77410a"}
Sep 15 21:29:25.479045 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.478743    2558 scope.go:117] "RemoveContainer" containerID="cdeda6c5a6b8fbcab2a43ff8ef46ebfa5762e75c2d191eaf4bd7b9626fd62a0b"
Sep 15 21:29:25.480065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.479931    2558 generic.go:356] "Generic (PLEG): container finished" podID="763fc743-254e-42d4-aa3e-7d301e6651c4" containerID="77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac" exitCode=0
Sep 15 21:29:25.480065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.479981    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" event={"ID":"763fc743-254e-42d4-aa3e-7d301e6651c4","Type":"ContainerDied","Data":"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"}
Sep 15 21:29:25.480065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.480004    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"
Sep 15 21:29:25.480065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.480031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2" event={"ID":"763fc743-254e-42d4-aa3e-7d301e6651c4","Type":"ContainerDied","Data":"3f0d1b7487a534e9a70d27917b7b95f2f7fc43500668d64a31ac3f05ec42c028"}
Sep 15 21:29:25.487142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.487115    2558 scope.go:117] "RemoveContainer" containerID="77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"
Sep 15 21:29:25.494450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.494430    2558 scope.go:117] "RemoveContainer" containerID="77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"
Sep 15 21:29:25.494705 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:25.494685    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac\": container with ID starting with 77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac not found: ID does not exist" containerID="77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"
Sep 15 21:29:25.494785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.494712    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac"} err="failed to get container status \"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac\": rpc error: code = NotFound desc = could not find container \"77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac\": container with ID starting with 77bddb6c691b2c7e99e3774ad500350c64f736b19cab4f78fdc05d9aa1912aac not found: ID does not exist"
Sep 15 21:29:25.495313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.495290    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:29:25.497300 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.497280    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-026d11-5796b45586-smfb7"]
Sep 15 21:29:25.510497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.510476    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:29:25.516232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.516214    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-026d11-75c7f75d74-k8dz2"]
Sep 15 21:29:25.563607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:25.563585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.462516 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:26.462488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.845178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:26.845102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:26.961773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:26.961696    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763fc743-254e-42d4-aa3e-7d301e6651c4" path="/var/lib/kubelet/pods/763fc743-254e-42d4-aa3e-7d301e6651c4/volumes"
Sep 15 21:29:26.962162 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:26.962142    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" path="/var/lib/kubelet/pods/e6937ea0-f1a5-44b0-ab0b-2db0a7881221/volumes"
Sep 15 21:29:27.701031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:27.701005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:27.801019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:27.800989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:27.900595 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:27.900575    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:28.170133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.170107    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:28.173701 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.173672    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:29:28.173996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.173984    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" containerName="maas-api"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.173997    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" containerName="maas-api"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174011    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174017    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174031    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174036    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174047    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763fc743-254e-42d4-aa3e-7d301e6651c4" containerName="payload-pre-processing"
Sep 15 21:29:28.174049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174052    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="763fc743-254e-42d4-aa3e-7d301e6651c4" containerName="payload-pre-processing"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174058    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" containerName="maas-api"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174062    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" containerName="maas-api"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174068    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c6b664-0f67-48ee-9617-f9a15a956d36" containerName="payload-processing"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174073    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c6b664-0f67-48ee-9617-f9a15a956d36" containerName="payload-processing"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174124    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6937ea0-f1a5-44b0-ab0b-2db0a7881221" containerName="maas-api"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174132    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df3a00b-d60d-4fc5-aa79-d0b645eba62f" containerName="maas-api"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174138    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174142    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd02d4f8-eaaa-4794-8f7a-f442f9a77bab" containerName="istio-proxy"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174149    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="763fc743-254e-42d4-aa3e-7d301e6651c4" containerName="payload-pre-processing"
Sep 15 21:29:28.174260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.174155    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c6b664-0f67-48ee-9617-f9a15a956d36" containerName="payload-processing"
Sep 15 21:29:28.177688 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.177655    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.182280 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.182256    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-dbcc8f-openshift-default-dockercfg-9qt5c\""
Sep 15 21:29:28.190779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.190757    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:29:28.277792 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.277763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:28.295914 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.295885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.295914 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.295918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.295940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7m4w\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.296304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.296248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.369125 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.369090    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:28.397034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397083    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7m4w\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.397825 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.397809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.399269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.399248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.399546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.399530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.405369 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.405346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.405637 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.405618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7m4w\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w\") pod \"e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") " pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.489761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.489737    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:28.760602 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.760578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:29:28.762485 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:29:28.762456    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09746c22_a697_4208_9442_1381271d3860.slice/crio-89145c8b6bfcbc4cef7d911794fd2d8b533d93f15facfbff91eb4925c8f86939 WatchSource:0}: Error finding container 89145c8b6bfcbc4cef7d911794fd2d8b533d93f15facfbff91eb4925c8f86939: Status 404 returned error can't find the container with id 89145c8b6bfcbc4cef7d911794fd2d8b533d93f15facfbff91eb4925c8f86939
Sep 15 21:29:28.764778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.764739    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:28.764859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.764822    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:28.764903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.764861    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:28.882291 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:28.882261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:29.499311 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:29.499273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerStarted","Data":"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"}
Sep 15 21:29:29.499698 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:29.499337    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerStarted","Data":"89145c8b6bfcbc4cef7d911794fd2d8b533d93f15facfbff91eb4925c8f86939"}
Sep 15 21:29:29.518230 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:29.518166    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podStartSLOduration=1.518143495 podStartE2EDuration="1.518143495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:29.517333617 +0000 UTC m=+1165.125030729" watchObservedRunningTime="2026-09-15 21:29:29.518143495 +0000 UTC m=+1165.125840591"
Sep 15 21:29:30.490705 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:30.490678    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:30.495655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:30.495632    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:30.503455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:30.503430    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:30.504245 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:30.504224    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:29:30.888613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:30.888501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.357904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.357871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.467095 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.467065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.585622 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.585595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.694337 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.694260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.791440 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.791408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:31.891601 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:31.891572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:32.195327 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.195299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:32.493089 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.493060    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:29:32.495423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.495390    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.497534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.497516    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f0d7d5-openshift-default-dockercfg-vx2p5\""
Sep 15 21:29:32.508067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.508041    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:29:32.528523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.528445    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:32.531610 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531810 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531900 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.531941 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.532006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.531979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4chk6\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.624683 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.624641    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:32.632791 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.632767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.632989 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.632941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633007    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633101 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633065    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633199 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633325 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633302    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4chk6\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633351    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633638 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633781 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.633839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.633779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.635445 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.635420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.635571 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.635552    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.647362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.647316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.647507 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.647360    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4chk6\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6\") pod \"e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") " pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.805359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.805273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:32.968023 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:32.967990    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:33.077590 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.077566    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:29:33.087234 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.087200    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:33.087312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.087264    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:33.087312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.087292    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:29:33.441557 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.441467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:33.520626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.520588    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" event={"ID":"c67859e0-e12a-4b40-9c42-24c62a2aa240","Type":"ContainerStarted","Data":"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"}
Sep 15 21:29:33.520787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.520685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" event={"ID":"c67859e0-e12a-4b40-9c42-24c62a2aa240","Type":"ContainerStarted","Data":"7ad83c27e2d10975d8ebe735b60e92bba196ecb26ac3457fad48255fed02f5c6"}
Sep 15 21:29:33.545577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.545534    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" podStartSLOduration=1.5455183080000001 podStartE2EDuration="1.545518308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:33.543634957 +0000 UTC m=+1169.151332044" watchObservedRunningTime="2026-09-15 21:29:33.545518308 +0000 UTC m=+1169.153215395"
Sep 15 21:29:33.806253 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.806221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:33.859939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.859912    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:33.957058 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:33.957026    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:34.057088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:34.057014    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:34.158508 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:34.158478    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:34.258984 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:34.258923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:34.810979 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:34.810941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:35.013459 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.013230    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:29:35.017017 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.016992    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.019160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.019135    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-dbcc8f-serving-cert\""
Sep 15 21:29:35.025252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.025221    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:29:35.053729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.053701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.055818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.055799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdjs\" (UniqueName: \"kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.055889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.055846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.055889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.055865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.056002 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.055982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.154788 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.154714    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.156462 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.156445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.156527 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.156485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdjs\" (UniqueName: \"kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.156527 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.156524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.156608 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.156539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.156661 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:35.156645    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-serving-cert: secret "maas-api-e2e-shared-a-w2-dbcc8f-serving-cert" not found
Sep 15 21:29:35.156708 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:29:35.156691    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls podName:2b55eefa-7268-407b-a005-7a2b44ff6a94 nodeName:}" failed. No retries permitted until 2026-09-15 21:29:35.656677424 +0000 UTC m=+1171.264374490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls") pod "maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" (UID: "2b55eefa-7268-407b-a005-7a2b44ff6a94") : secret "maas-api-e2e-shared-a-w2-dbcc8f-serving-cert" not found
Sep 15 21:29:35.157096 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.157077    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.158833 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.158814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.164651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.164627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdjs\" (UniqueName: \"kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.254448 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.254421    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.529081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.529056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:35.529985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.529964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:29:35.538631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.538586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.633768 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.633736    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:35.661764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.661732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.664146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.664122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:35.929490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:35.929414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:36.202561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:36.202537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:29:36.204443 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:29:36.204418    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b55eefa_7268_407b_a005_7a2b44ff6a94.slice/crio-d25e107528766e899a9f1a074a7ca8b3de62b1e74a2d17fdc6c11899803e6ded WatchSource:0}: Error finding container d25e107528766e899a9f1a074a7ca8b3de62b1e74a2d17fdc6c11899803e6ded: Status 404 returned error can't find the container with id d25e107528766e899a9f1a074a7ca8b3de62b1e74a2d17fdc6c11899803e6ded
Sep 15 21:29:36.534507 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:36.534474    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" event={"ID":"2b55eefa-7268-407b-a005-7a2b44ff6a94","Type":"ContainerStarted","Data":"d25e107528766e899a9f1a074a7ca8b3de62b1e74a2d17fdc6c11899803e6ded"}
Sep 15 21:29:37.540859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:37.540823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" event={"ID":"2b55eefa-7268-407b-a005-7a2b44ff6a94","Type":"ContainerStarted","Data":"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"}
Sep 15 21:29:37.541310 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:37.540890    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:37.558489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:37.558444    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" podStartSLOduration=2.977615727 podStartE2EDuration="3.558428739s" totalImagesPullingTime="580.813012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:29:37.556678317 +0000 UTC m=+1173.164375397" watchObservedRunningTime="2026-09-15 21:29:37.558428739 +0000 UTC m=+1173.166125827"
Sep 15 21:29:38.409352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:38.409314    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:29:43.550419 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:43.550387    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:29:46.079436 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:46.079398    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:49.625181 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:49.625149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:55.938423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:55.938377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:57.238857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:57.238821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:57.945963 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:57.945869    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:58.735441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:58.735400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:29:59.568160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:29:59.568128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:00.348651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:00.348592    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:01.229686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:01.229654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:01.898579 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:01.898540    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:02.348149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.348107    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:02.455585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.455550    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:30:02.460362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.460340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.462469 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.462445    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-c39135-openshift-default-dockercfg-zcfjj\""
Sep 15 21:30:02.471093 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.471070    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:30:02.588736 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mszwj\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.588903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588748    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.588903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.588903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.588903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.588903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.589124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.589124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.588959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.589124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.589034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.680208 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.680122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:02.689606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.689729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszwj\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.689729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689655    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.689729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.689729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.689729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689777    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.689803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.690014    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690037 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.690032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.690236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690454 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.690434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.690510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.690493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.692347 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.692323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.692534 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.692519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.699515 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.699494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszwj\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.699815 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.699794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token\") pod \"e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") " pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:02.771477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.771432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:02.772394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:02.772368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:03.049203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.049175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:30:03.051763 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:30:03.051735    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22787044_1ce6_435e_a3b4_ad623a17b07f.slice/crio-ee7584d2a120880946417bffada5e74811e72fda280374fccb53997169240821 WatchSource:0}: Error finding container ee7584d2a120880946417bffada5e74811e72fda280374fccb53997169240821: Status 404 returned error can't find the container with id ee7584d2a120880946417bffada5e74811e72fda280374fccb53997169240821
Sep 15 21:30:03.054218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.054180    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.054312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.054264    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.054377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.054309    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.654613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.654528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerStarted","Data":"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"}
Sep 15 21:30:03.654613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.654585    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerStarted","Data":"ee7584d2a120880946417bffada5e74811e72fda280374fccb53997169240821"}
Sep 15 21:30:03.656146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.656121    2558 generic.go:356] "Generic (PLEG): container finished" podID="09746c22-a697-4208-9442-1381271d3860" containerID="4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9" exitCode=0
Sep 15 21:30:03.656239 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.656158    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerDied","Data":"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"}
Sep 15 21:30:03.656480 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.656467    2558 scope.go:117] "RemoveContainer" containerID="4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"
Sep 15 21:30:03.657553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.657525    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.657617 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.657605    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.657657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.657637    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:03.676477 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.676439    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podStartSLOduration=1.676424673 podStartE2EDuration="1.676424673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:03.674279741 +0000 UTC m=+1199.281976824" watchObservedRunningTime="2026-09-15 21:30:03.676424673 +0000 UTC m=+1199.284121761"
Sep 15 21:30:03.772970 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:03.772916    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:04.664248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:04.664203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerStarted","Data":"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"}
Sep 15 21:30:04.778471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:04.778439    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:05.033290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.033260    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:05.490587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.490552    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:30:05.490806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.490781    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 15 21:30:05.490885 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.490842    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 15 21:30:05.601435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.601404    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:05.669184 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.669152    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:05.670250 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.670233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:05.696506 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.696482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:05.968081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:05.968046    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:06.490980 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:06.490929    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 15 21:30:06.491152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:06.491004    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 15 21:30:06.754939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:06.754845    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:07.490634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:07.490595    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 15 21:30:07.490810 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:07.490654    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 15 21:30:07.653563 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:07.653529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:08.437060 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:08.437021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:08.490332 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:08.490302    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 15 21:30:08.490492 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:08.490354    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 15 21:30:09.351070 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:09.351031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:09.490348 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:09.490315    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Sep 15 21:30:09.490728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:09.490369    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Sep 15 21:30:10.015125 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.015094    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:30:10.019080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.019060    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.021210 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.021181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-c39135-serving-cert\""
Sep 15 21:30:10.029394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.029369    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:30:10.048108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.048086    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.056192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.056170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfggl\" (UniqueName: \"kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.056294 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.056236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.056294 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.056285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.056368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.056318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.149634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.149606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.156818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.156793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.156921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.156834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.156921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.156857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.156921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.156915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfggl\" (UniqueName: \"kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.157405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.157377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.159211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.159195    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.159305 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.159230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.165150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.165129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfggl\" (UniqueName: \"kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl\") pod \"maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.249658 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.249629    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.314001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.313893    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:30:10.330109 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.330085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:10.493637 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.493611    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:30:10.494008 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.493911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:30:10.494576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.494558    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:30:10.549853 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.549763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.603711 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.603686    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:30:10.605734 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:30:10.605708    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0740bd59_09e2_4c60_bc51_9f848c737a3e.slice/crio-2c8266117ed0e1f828718054e259978d663f03ab7a2a03f84d6fccb1b8587979 WatchSource:0}: Error finding container 2c8266117ed0e1f828718054e259978d663f03ab7a2a03f84d6fccb1b8587979: Status 404 returned error can't find the container with id 2c8266117ed0e1f828718054e259978d663f03ab7a2a03f84d6fccb1b8587979
Sep 15 21:30:10.626538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.626511    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:10.691997 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:10.691966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" event={"ID":"0740bd59-09e2-4c60-bc51-9f848c737a3e","Type":"ContainerStarted","Data":"2c8266117ed0e1f828718054e259978d663f03ab7a2a03f84d6fccb1b8587979"}
Sep 15 21:30:11.700228 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:11.700196    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" event={"ID":"0740bd59-09e2-4c60-bc51-9f848c737a3e","Type":"ContainerStarted","Data":"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"}
Sep 15 21:30:11.717573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:11.717528    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" podStartSLOduration=2.410234617 podStartE2EDuration="2.717512093s" totalImagesPullingTime="307.277476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:11.71670944 +0000 UTC m=+1207.324406528" watchObservedRunningTime="2026-09-15 21:30:11.717512093 +0000 UTC m=+1207.325209191"
Sep 15 21:30:12.704641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:12.704615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:15.613968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:15.611402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:18.714514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:18.714482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:30:32.954939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:32.954859    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:33.055176 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:33.055141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:33.487001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:33.486969    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:34.249716 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:34.249660    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:34.947624 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:34.947583    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:35.713257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:35.713210    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:35.879629 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:35.879601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:36.408861 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:36.408829    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:40.840837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.840809    2558 generic.go:356] "Generic (PLEG): container finished" podID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerID="bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c" exitCode=0
Sep 15 21:30:40.841225 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.840871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerDied","Data":"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"}
Sep 15 21:30:40.841266 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.841251    2558 scope.go:117] "RemoveContainer" containerID="bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"
Sep 15 21:30:40.842428 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.842399    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:40.842491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.842466    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:40.842526 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:40.842494    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:30:41.847221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:41.847184    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerStarted","Data":"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"}
Sep 15 21:30:42.773544 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:42.773475    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:42.773677 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:42.773639    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:42.773718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:42.773688    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:43.306150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:43.306110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:30:43.773592 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:43.773553    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:43.773776 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:43.773620    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:44.772924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:44.772891    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:44.773351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:44.772975    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:44.951775 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:44.951741    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:45.707297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:45.707266    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:45.772886 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:45.772852    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:45.773047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:45.772908    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:46.087114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:46.087087    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:46.389434 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:46.389351    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:46.773759 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:46.773727    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:46.774139 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:46.773785    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:47.773307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:47.773266    2558 patch_prober.go:28] interesting pod/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 15 21:30:47.773510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:47.773333    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 15 21:30:48.777470 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:48.777442    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:48.777889 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:48.777690    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:48.778421 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:48.778400    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:30:49.039838 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:49.039764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:49.203698 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:49.203665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:49.296108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:49.296031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:49.869085 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:49.869055    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:50.787344 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:50.787314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:51.713505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:51.713473    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.136657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.136578    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:30:52.136810 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.136758    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" podUID="c67859e0-e12a-4b40-9c42-24c62a2aa240" containerName="istio-proxy" containerID="cri-o://ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2" gracePeriod=30
Sep 15 21:30:52.161745 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.161720    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.391452 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.391372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.494651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.494616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:52.595241 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:52.595214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:53.300856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:53.300821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.001359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.001321    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:30:54.004260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.004236    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.006095 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.006072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d1980a0d-serving-cert\""
Sep 15 21:30:54.014927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.014900    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:30:54.030763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.030727    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.043636 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.043606    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.043777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.043647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqtc\" (UniqueName: \"kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.043828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.043774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.043876 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.043839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.132140 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.132109    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.144420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.144388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.144519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.144424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqtc\" (UniqueName: \"kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.144519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.144494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.144596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.144549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.144656 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:30:54.144643    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-serving-cert: secret "maas-api-e2e-mt-d1980a0d-serving-cert" not found
Sep 15 21:30:54.144709 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:30:54.144699    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls podName:33071570-ca1b-4f62-aab7-300016c0d29f nodeName:}" failed. No retries permitted until 2026-09-15 21:30:54.644681599 +0000 UTC m=+1250.252378666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls") pod "maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" (UID: "33071570-ca1b-4f62-aab7-300016c0d29f") : secret "maas-api-e2e-mt-d1980a0d-serving-cert" not found
Sep 15 21:30:54.145231 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.145210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.146843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.146825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.152389 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.152369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqtc\" (UniqueName: \"kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.372664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.372579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.521538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.521507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.621133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.621100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:54.627740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.627673    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:30:54.630052 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.630035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.632389 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.632369    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d1980a0d\""
Sep 15 21:30:54.643657 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.643637    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:30:54.649568 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.649537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.649673 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.649588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnx78\" (UniqueName: \"kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.649673 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.649626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.651801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.651783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") pod \"maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.750530 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.750470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.751649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.751617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnx78\" (UniqueName: \"kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.751843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.751523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.762842 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.762820    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnx78\" (UniqueName: \"kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78\") pod \"payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:54.915011 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.914915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:54.940268 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:54.940235    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:55.183898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.183876    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:30:55.186235 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:30:55.186209    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33071570_ca1b_4f62_aab7_300016c0d29f.slice/crio-76992975249d1436e0b0d6dd1bbb600c2c31c421df94e221f34623dfc5f307d6 WatchSource:0}: Error finding container 76992975249d1436e0b0d6dd1bbb600c2c31c421df94e221f34623dfc5f307d6: Status 404 returned error can't find the container with id 76992975249d1436e0b0d6dd1bbb600c2c31c421df94e221f34623dfc5f307d6
Sep 15 21:30:55.215727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.215708    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:30:55.217763 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:30:55.217731    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod316beaca_359a_4e29_9268_fc7036035d20.slice/crio-63e1587a103b8cbcbf1e4fa6379d6374f1db770a7155a034295621a4e975f256 WatchSource:0}: Error finding container 63e1587a103b8cbcbf1e4fa6379d6374f1db770a7155a034295621a4e975f256: Status 404 returned error can't find the container with id 63e1587a103b8cbcbf1e4fa6379d6374f1db770a7155a034295621a4e975f256
Sep 15 21:30:55.921119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.921085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" event={"ID":"33071570-ca1b-4f62-aab7-300016c0d29f","Type":"ContainerStarted","Data":"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"}
Sep 15 21:30:55.921546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.921139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" event={"ID":"33071570-ca1b-4f62-aab7-300016c0d29f","Type":"ContainerStarted","Data":"76992975249d1436e0b0d6dd1bbb600c2c31c421df94e221f34623dfc5f307d6"}
Sep 15 21:30:55.921546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.921169    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:30:55.922768 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.922746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" event={"ID":"316beaca-359a-4e29-9268-fc7036035d20","Type":"ContainerStarted","Data":"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"}
Sep 15 21:30:55.922881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.922791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" event={"ID":"316beaca-359a-4e29-9268-fc7036035d20","Type":"ContainerStarted","Data":"63e1587a103b8cbcbf1e4fa6379d6374f1db770a7155a034295621a4e975f256"}
Sep 15 21:30:55.922881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.922853    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:30:55.939773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.939704    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" podStartSLOduration=2.438727085 podStartE2EDuration="2.93968817s" totalImagesPullingTime="500.961085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:55.938574816 +0000 UTC m=+1251.546271918" watchObservedRunningTime="2026-09-15 21:30:55.93968817 +0000 UTC m=+1251.547385260"
Sep 15 21:30:55.953841 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:55.953808    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" podStartSLOduration=1.953796107 podStartE2EDuration="1.953796107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:30:55.952863843 +0000 UTC m=+1251.560560930" watchObservedRunningTime="2026-09-15 21:30:55.953796107 +0000 UTC m=+1251.561493209"
Sep 15 21:30:57.379290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.379266    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:30:57.475660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475635    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.475790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475668    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.475790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.475790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475702    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.475790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.475790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475765    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.476073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475792    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4chk6\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.476073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475822    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.476073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475848    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token\") pod \"c67859e0-e12a-4b40-9c42-24c62a2aa240\" (UID: \"c67859e0-e12a-4b40-9c42-24c62a2aa240\") "
Sep 15 21:30:57.476073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475911    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:30:57.476073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.475991    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data" (OuterVolumeSpecName: "istio-data") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:30:57.476322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.476140    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.476322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.476140    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:30:57.476322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.476158    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.476322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.476224    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:30:57.476521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.476361    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:30:57.477828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.477790    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:30:57.478004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.477877    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6" (OuterVolumeSpecName: "kube-api-access-4chk6") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "kube-api-access-4chk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:30:57.478004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.477925    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:30:57.478004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.477937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token" (OuterVolumeSpecName: "istio-token") pod "c67859e0-e12a-4b40-9c42-24c62a2aa240" (UID: "c67859e0-e12a-4b40-9c42-24c62a2aa240"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:30:57.550377 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.550355    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:30:57.576685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576667    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576686    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576695    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576703    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c67859e0-e12a-4b40-9c42-24c62a2aa240-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576712    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4chk6\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-kube-api-access-4chk6\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576721    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c67859e0-e12a-4b40-9c42-24c62a2aa240-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.576796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.576728    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c67859e0-e12a-4b40-9c42-24c62a2aa240-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:30:57.932443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.932366    2558 generic.go:356] "Generic (PLEG): container finished" podID="c67859e0-e12a-4b40-9c42-24c62a2aa240" containerID="ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2" exitCode=0
Sep 15 21:30:57.932443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.932414    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"
Sep 15 21:30:57.932649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.932445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" event={"ID":"c67859e0-e12a-4b40-9c42-24c62a2aa240","Type":"ContainerDied","Data":"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"}
Sep 15 21:30:57.932649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.932520    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7" event={"ID":"c67859e0-e12a-4b40-9c42-24c62a2aa240","Type":"ContainerDied","Data":"7ad83c27e2d10975d8ebe735b60e92bba196ecb26ac3457fad48255fed02f5c6"}
Sep 15 21:30:57.932649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.932541    2558 scope.go:117] "RemoveContainer" containerID="ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"
Sep 15 21:30:57.941351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.941331    2558 scope.go:117] "RemoveContainer" containerID="ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"
Sep 15 21:30:57.941600 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:30:57.941581    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2\": container with ID starting with ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2 not found: ID does not exist" containerID="ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"
Sep 15 21:30:57.941651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.941607    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2"} err="failed to get container status \"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2\": rpc error: code = NotFound desc = could not find container \"ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2\": container with ID starting with ac6f0a199327548fff4bf22781e3eee29f4bee32aef9879b2546b735419105c2 not found: ID does not exist"
Sep 15 21:30:57.953651 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.953629    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:30:57.957577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:57.957557    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f0d7d5-openshift-default-88cf464cb-rqlv7"]
Sep 15 21:30:58.961280 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:30:58.961245    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c67859e0-e12a-4b40-9c42-24c62a2aa240" path="/var/lib/kubelet/pods/c67859e0-e12a-4b40-9c42-24c62a2aa240/volumes"
Sep 15 21:31:01.932771 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:01.932740    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:31:02.281907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:02.281878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:06.929633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:06.929594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:31:06.947463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:06.947437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:07.786986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:07.786941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:08.509081 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:08.509047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:09.346236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:09.346202    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:10.120837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:10.120795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:10.918199 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:10.918152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:11.749875 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:11.749843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:12.556107 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:12.556075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:13.226322 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:13.226290    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:13.939165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:13.939134    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:14.203387 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:14.203297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:14.618787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:14.618740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:15.448269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:15.448228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.010870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:18.010835    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.076410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:18.076379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.139088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:18.139061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.239856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:18.239828    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:18.897165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:18.897135    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:19.650299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:19.650253    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:20.442939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:20.442907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:23.217276 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:23.217245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:23.317217 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:23.317185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:23.529759 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:23.529665    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:24.296844 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:24.296816    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:24.397405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:24.397376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:25.919214 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:25.919182    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:31:26.426832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:26.426799    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:26.496189 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:26.496149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:26.555591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:26.555565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:27.220096 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:27.220062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:27.325669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:27.325642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:27.882229 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:27.882196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:28.133368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:28.133267    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:28.887740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:28.887708    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:29.637039 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:29.637007    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:30.349876 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:30.349852    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:33.270152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:33.270115    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:35.330295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.330251    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:31:35.330768 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.330509    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" podUID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" containerName="maas-api" containerID="cri-o://e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599" gracePeriod=30
Sep 15 21:31:35.386003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.385966    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:31:35.386258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.386213    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" podUID="5c3d4154-8186-4939-ac6e-5f77c614f821" containerName="payload-processing" containerID="cri-o://66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067" gracePeriod=30
Sep 15 21:31:35.391339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.391309    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:31:35.391588 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.391546    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" podUID="da600745-58c0-4c79-b5e4-41b89a5a64a1" containerName="payload-pre-processing" containerID="cri-o://948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4" gracePeriod=30
Sep 15 21:31:35.638414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.632494    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:31:35.667329 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.667041    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:31:35.704862 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.704837    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:31:35.809128 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809099    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume\") pod \"5c3d4154-8186-4939-ac6e-5f77c614f821\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") "
Sep 15 21:31:35.809297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809144    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume\") pod \"da600745-58c0-4c79-b5e4-41b89a5a64a1\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") "
Sep 15 21:31:35.809297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809182    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca\") pod \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") "
Sep 15 21:31:35.809297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809263    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") pod \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") "
Sep 15 21:31:35.809297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809284    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs\") pod \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") "
Sep 15 21:31:35.809297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809299    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt7r2\" (UniqueName: \"kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2\") pod \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\" (UID: \"b140f4cd-40fd-4545-9e06-a2cef7cb52bd\") "
Sep 15 21:31:35.809576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk8dv\" (UniqueName: \"kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv\") pod \"da600745-58c0-4c79-b5e4-41b89a5a64a1\" (UID: \"da600745-58c0-4c79-b5e4-41b89a5a64a1\") "
Sep 15 21:31:35.809576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809328    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm8bc\" (UniqueName: \"kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc\") pod \"5c3d4154-8186-4939-ac6e-5f77c614f821\" (UID: \"5c3d4154-8186-4939-ac6e-5f77c614f821\") "
Sep 15 21:31:35.809576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809554    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c3d4154-8186-4939-ac6e-5f77c614f821" (UID: "5c3d4154-8186-4939-ac6e-5f77c614f821"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:31:35.809739 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809557    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b140f4cd-40fd-4545-9e06-a2cef7cb52bd" (UID: "b140f4cd-40fd-4545-9e06-a2cef7cb52bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:31:35.809986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.809942    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da600745-58c0-4c79-b5e4-41b89a5a64a1" (UID: "da600745-58c0-4c79-b5e4-41b89a5a64a1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:31:35.811451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.811431    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc" (OuterVolumeSpecName: "kube-api-access-wm8bc") pod "5c3d4154-8186-4939-ac6e-5f77c614f821" (UID: "5c3d4154-8186-4939-ac6e-5f77c614f821"). InnerVolumeSpecName "kube-api-access-wm8bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:35.811896 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.811876    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b140f4cd-40fd-4545-9e06-a2cef7cb52bd" (UID: "b140f4cd-40fd-4545-9e06-a2cef7cb52bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:31:35.812077 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.811901    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2" (OuterVolumeSpecName: "kube-api-access-rt7r2") pod "b140f4cd-40fd-4545-9e06-a2cef7cb52bd" (UID: "b140f4cd-40fd-4545-9e06-a2cef7cb52bd"). InnerVolumeSpecName "kube-api-access-rt7r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:35.812077 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.811987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b140f4cd-40fd-4545-9e06-a2cef7cb52bd" (UID: "b140f4cd-40fd-4545-9e06-a2cef7cb52bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:31:35.812077 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.811995    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv" (OuterVolumeSpecName: "kube-api-access-bk8dv") pod "da600745-58c0-4c79-b5e4-41b89a5a64a1" (UID: "da600745-58c0-4c79-b5e4-41b89a5a64a1"). InnerVolumeSpecName "kube-api-access-bk8dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910054    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910076    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910085    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt7r2\" (UniqueName: \"kubernetes.io/projected/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-kube-api-access-rt7r2\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910094    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk8dv\" (UniqueName: \"kubernetes.io/projected/da600745-58c0-4c79-b5e4-41b89a5a64a1-kube-api-access-bk8dv\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910102    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm8bc\" (UniqueName: \"kubernetes.io/projected/5c3d4154-8186-4939-ac6e-5f77c614f821-kube-api-access-wm8bc\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910111    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c3d4154-8186-4939-ac6e-5f77c614f821-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910119 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910119    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da600745-58c0-4c79-b5e4-41b89a5a64a1-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:35.910414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:35.910127    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b140f4cd-40fd-4545-9e06-a2cef7cb52bd-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:31:36.101150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.101114    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c3d4154-8186-4939-ac6e-5f77c614f821" containerID="66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067" exitCode=0
Sep 15 21:31:36.101308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.101172    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"
Sep 15 21:31:36.101308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.101199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" event={"ID":"5c3d4154-8186-4939-ac6e-5f77c614f821","Type":"ContainerDied","Data":"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"}
Sep 15 21:31:36.101308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.101257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d" event={"ID":"5c3d4154-8186-4939-ac6e-5f77c614f821","Type":"ContainerDied","Data":"968ac94f3a222100f700e66d9a7dec367c0bf25725e9f37b36655c8fb87285d7"}
Sep 15 21:31:36.101308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.101278    2558 scope.go:117] "RemoveContainer" containerID="66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"
Sep 15 21:31:36.102753 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.102731    2558 generic.go:356] "Generic (PLEG): container finished" podID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" containerID="e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599" exitCode=0
Sep 15 21:31:36.102848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.102772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"
Sep 15 21:31:36.102848 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.102810    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" event={"ID":"b140f4cd-40fd-4545-9e06-a2cef7cb52bd","Type":"ContainerDied","Data":"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"}
Sep 15 21:31:36.102976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.102855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck" event={"ID":"b140f4cd-40fd-4545-9e06-a2cef7cb52bd","Type":"ContainerDied","Data":"7541c5f8bb9bef6299682f3b19c6ed29089c3cd671ae9bfa8275ca6ad6e8eb40"}
Sep 15 21:31:36.104497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.104474    2558 generic.go:356] "Generic (PLEG): container finished" podID="da600745-58c0-4c79-b5e4-41b89a5a64a1" containerID="948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4" exitCode=0
Sep 15 21:31:36.104577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.104515    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"
Sep 15 21:31:36.104577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.104539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" event={"ID":"da600745-58c0-4c79-b5e4-41b89a5a64a1","Type":"ContainerDied","Data":"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"}
Sep 15 21:31:36.104692 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.104579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s" event={"ID":"da600745-58c0-4c79-b5e4-41b89a5a64a1","Type":"ContainerDied","Data":"713f9f769ad6afab48264ed1f9c35a2a067eb257df678c123baab1073fc33dee"}
Sep 15 21:31:36.110921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.110891    2558 scope.go:117] "RemoveContainer" containerID="66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"
Sep 15 21:31:36.111267 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:31:36.111231    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067\": container with ID starting with 66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067 not found: ID does not exist" containerID="66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"
Sep 15 21:31:36.111341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.111268    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067"} err="failed to get container status \"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067\": rpc error: code = NotFound desc = could not find container \"66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067\": container with ID starting with 66ff7ab87b82cc7650f9e9f0ba95017244144a32d7b259631e065fddb66a9067 not found: ID does not exist"
Sep 15 21:31:36.111341 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.111289    2558 scope.go:117] "RemoveContainer" containerID="e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"
Sep 15 21:31:36.119128 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.119114    2558 scope.go:117] "RemoveContainer" containerID="e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"
Sep 15 21:31:36.119372 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:31:36.119354    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599\": container with ID starting with e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599 not found: ID does not exist" containerID="e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"
Sep 15 21:31:36.119431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.119378    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599"} err="failed to get container status \"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599\": rpc error: code = NotFound desc = could not find container \"e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599\": container with ID starting with e4ce152a8ae795103579cab236ab1f35a3adbcfad18fa99aa0a70cb59592d599 not found: ID does not exist"
Sep 15 21:31:36.119431 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.119393    2558 scope.go:117] "RemoveContainer" containerID="948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"
Sep 15 21:31:36.124851 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.124832    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:31:36.126430 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.126418    2558 scope.go:117] "RemoveContainer" containerID="948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"
Sep 15 21:31:36.126643 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:31:36.126625    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4\": container with ID starting with 948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4 not found: ID does not exist" containerID="948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"
Sep 15 21:31:36.126685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.126650    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4"} err="failed to get container status \"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4\": rpc error: code = NotFound desc = could not find container \"948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4\": container with ID starting with 948203e0f3e974c3eddb5fe491f85b6b38ae33c5fdb239213fa088b9140189f4 not found: ID does not exist"
Sep 15 21:31:36.130586 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.130564    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-f457e5-6d4b8f6599-8kh8d"]
Sep 15 21:31:36.141474 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.141452    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:31:36.148049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.148030    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f457e5-5c4d4dccbb-sts2s"]
Sep 15 21:31:36.162859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.162801    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:31:36.164443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.164425    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f457e5-664c5df67d-gpbck"]
Sep 15 21:31:36.545247 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.545219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:36.732031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.732001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:36.962262 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.962233    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3d4154-8186-4939-ac6e-5f77c614f821" path="/var/lib/kubelet/pods/5c3d4154-8186-4939-ac6e-5f77c614f821/volumes"
Sep 15 21:31:36.962596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.962583    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" path="/var/lib/kubelet/pods/b140f4cd-40fd-4545-9e06-a2cef7cb52bd/volumes"
Sep 15 21:31:36.962882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:36.962870    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da600745-58c0-4c79-b5e4-41b89a5a64a1" path="/var/lib/kubelet/pods/da600745-58c0-4c79-b5e4-41b89a5a64a1/volumes"
Sep 15 21:31:37.468068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:37.468033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:38.161350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:38.161321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:38.941705 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:38.941670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:39.611854 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:39.611814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:40.500606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:40.500575    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:40.984146 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:40.984113    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:46.833260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:46.833225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:47.087051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.086935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:47.667238 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.667208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:47.948320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948251    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948580    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c67859e0-e12a-4b40-9c42-24c62a2aa240" containerName="istio-proxy"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948590    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c67859e0-e12a-4b40-9c42-24c62a2aa240" containerName="istio-proxy"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948600    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da600745-58c0-4c79-b5e4-41b89a5a64a1" containerName="payload-pre-processing"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948606    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da600745-58c0-4c79-b5e4-41b89a5a64a1" containerName="payload-pre-processing"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948613    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" containerName="maas-api"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948618    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" containerName="maas-api"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948628    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3d4154-8186-4939-ac6e-5f77c614f821" containerName="payload-processing"
Sep 15 21:31:47.948641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948633    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3d4154-8186-4939-ac6e-5f77c614f821" containerName="payload-processing"
Sep 15 21:31:47.948881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948689    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b140f4cd-40fd-4545-9e06-a2cef7cb52bd" containerName="maas-api"
Sep 15 21:31:47.948881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948700    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c67859e0-e12a-4b40-9c42-24c62a2aa240" containerName="istio-proxy"
Sep 15 21:31:47.948881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948706    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="da600745-58c0-4c79-b5e4-41b89a5a64a1" containerName="payload-pre-processing"
Sep 15 21:31:47.948881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.948712    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3d4154-8186-4939-ac6e-5f77c614f821" containerName="payload-processing"
Sep 15 21:31:47.952300 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.952278    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:47.954350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.954329    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-f36399-openshift-default-dockercfg-j74dc\""
Sep 15 21:31:47.962276 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.962256    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:31:47.975814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:47.975790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:48.005743 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.005869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.005869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.005869 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.006076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.006076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.005970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.006076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.006021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.006076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.006045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.006076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.006068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mldt\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.106832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.106796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107027 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.106843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107027 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.106859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107027 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.106988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mldt\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107097    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107560 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107621    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.107762 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.107623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.109270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.109248    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.109453 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.109439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.115421 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.115394    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mldt\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.115542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.115525    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token\") pod \"e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") " pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.244981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.244933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:48.263961 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.263921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:48.540557 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.540477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:31:48.543102 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:31:48.543075    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfead5e95_5c0e_4761_8b52_9af0a0b28328.slice/crio-26de9350c9e99ebacf8aab47effe860468a770add587c52043dcd6dc7c721bc7 WatchSource:0}: Error finding container 26de9350c9e99ebacf8aab47effe860468a770add587c52043dcd6dc7c721bc7: Status 404 returned error can't find the container with id 26de9350c9e99ebacf8aab47effe860468a770add587c52043dcd6dc7c721bc7
Sep 15 21:31:48.545373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.545338    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:31:48.545495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.545418    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:31:48.545495 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:48.545462    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:31:49.165368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:49.165333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerStarted","Data":"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"}
Sep 15 21:31:49.165807 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:49.165394    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerStarted","Data":"26de9350c9e99ebacf8aab47effe860468a770add587c52043dcd6dc7c721bc7"}
Sep 15 21:31:49.185592 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:49.185549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podStartSLOduration=2.185533792 podStartE2EDuration="2.185533792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:49.183499217 +0000 UTC m=+1304.791196305" watchObservedRunningTime="2026-09-15 21:31:49.185533792 +0000 UTC m=+1304.793230880"
Sep 15 21:31:49.264253 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:49.264228    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:49.268931 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:49.268911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:50.169586 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:50.169560    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:50.170359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:50.170339    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:31:50.405245 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:50.405219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:51.115131 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:51.115094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:51.213980 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:51.213933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:51.866135 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:51.866106    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:54.839716 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:54.839681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:54.908711 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:54.908680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.004754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.004722    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.147858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.147778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.251615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.251582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.477429 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.477397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.587712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.587679    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:31:55.620633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.620602    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:31:55.623144 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.623129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.625148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.625129    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-f36399\""
Sep 15 21:31:55.634502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.634479    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:31:55.678570 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.678549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.678688 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.678597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbzj7\" (UniqueName: \"kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.779504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.779420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.779504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.779487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbzj7\" (UniqueName: \"kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.780315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.780296    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.787631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.787605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbzj7\" (UniqueName: \"kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7\") pod \"payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:55.933200 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:55.933169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:56.203172 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:56.203148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:31:56.205413 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:31:56.205383    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5841a94e_8478_4508_90db_5992dcaf3fae.slice/crio-11b079e4f214be4a7525d1e0b25d4d2b474072a8c2a999060ff828aecbf38f72 WatchSource:0}: Error finding container 11b079e4f214be4a7525d1e0b25d4d2b474072a8c2a999060ff828aecbf38f72: Status 404 returned error can't find the container with id 11b079e4f214be4a7525d1e0b25d4d2b474072a8c2a999060ff828aecbf38f72
Sep 15 21:31:56.712957 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:56.712908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:31:57.200692 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:57.200611    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" event={"ID":"5841a94e-8478-4508-90db-5992dcaf3fae","Type":"ContainerStarted","Data":"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"}
Sep 15 21:31:57.200692 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:57.200673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" event={"ID":"5841a94e-8478-4508-90db-5992dcaf3fae","Type":"ContainerStarted","Data":"11b079e4f214be4a7525d1e0b25d4d2b474072a8c2a999060ff828aecbf38f72"}
Sep 15 21:31:57.201156 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:57.200718    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:31:57.225544 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:31:57.225496    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" podStartSLOduration=2.225481569 podStartE2EDuration="2.225481569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:31:57.225324144 +0000 UTC m=+1312.833021233" watchObservedRunningTime="2026-09-15 21:31:57.225481569 +0000 UTC m=+1312.833178656"
Sep 15 21:32:08.207476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:08.207447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:32:16.899924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:16.899889    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:17.618464 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:17.618431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:18.310837 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.310805    2558 generic.go:356] "Generic (PLEG): container finished" podID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerID="cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5" exitCode=0
Sep 15 21:32:18.311244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.310877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerDied","Data":"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"}
Sep 15 21:32:18.311297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.311266    2558 scope.go:117] "RemoveContainer" containerID="cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"
Sep 15 21:32:18.312329 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.312300    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:32:18.312391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.312367    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:32:18.312427 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.312403    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:32:18.447636 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.447602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:18.613652 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:18.613570    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:32:19.154972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.146536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:19.260291 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.260258    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:19.318927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.318896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerStarted","Data":"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"}
Sep 15 21:32:19.684720 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.684684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:19.785212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.785179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:19.977382 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:19.977352    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:20.170536 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:20.170508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:32:20.264817 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:20.264723    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:32:20.265893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:20.265864    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 21:32:20.266013 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:20.265917    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 21:32:20.761522 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:20.761478    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.202849 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.202761    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.264628 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.264594    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 21:32:21.264813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.264651    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 21:32:21.525044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.525015    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.628155 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.628127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.839589 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.839507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:21.933198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:21.933149    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:22.264917 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:22.264880    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 21:32:22.265138 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:22.264974    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 21:32:23.265311 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:23.265266    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 21:32:23.265788 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:23.265333    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 21:32:24.265133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:24.265096    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 15 21:32:24.265308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:24.265155    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 15 21:32:24.612067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:24.611978    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:25.268839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:25.268806    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:32:25.270001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:25.269976    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:32:25.911396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:25.911359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:26.010763 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:26.010738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:26.681758 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:26.681724    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:27.579664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:27.579627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:28.264282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:28.264241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:29.214390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.214357    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:29.930822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.930785    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:32:29.934078 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.934057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:29.936069 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.936051    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-745dff-serving-cert\""
Sep 15 21:32:29.942834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.942810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:32:29.963303 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:29.963271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.064218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.064184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.091614 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.091572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.091785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.091627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l4t2\" (UniqueName: \"kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.091785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.091734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.091785 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.091764    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.193142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.193050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.193142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.193092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.193323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.193149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.193323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.193169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l4t2\" (UniqueName: \"kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.193323 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:32:30.193279    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-serving-cert: secret "maas-api-e2e-shared-b-w3-745dff-serving-cert" not found
Sep 15 21:32:30.193489 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:32:30.193358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls podName:d2993d25-4373-4c1b-aecf-fc44c9bdafc4 nodeName:}" failed. No retries permitted until 2026-09-15 21:32:30.693333722 +0000 UTC m=+1346.301030803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls") pod "maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" (UID: "d2993d25-4373-4c1b-aecf-fc44c9bdafc4") : secret "maas-api-e2e-shared-b-w3-745dff-serving-cert" not found
Sep 15 21:32:30.193811 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.193779    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.195688 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.195672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.201518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.201498    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l4t2\" (UniqueName: \"kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.545214 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.545182    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.650573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.650534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.697170 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.697122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.699483 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.699462    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.716484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.716462    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:30.723390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.723369    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:32:30.726056 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.726041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:30.728031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.728011    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-745dff\""
Sep 15 21:32:30.728139 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.728040    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-745dff-dockercfg-gmdzz\""
Sep 15 21:32:30.736724 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.736702    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:32:30.846696 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.846613    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:30.898707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.898669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:30.898806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:30.898730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk87q\" (UniqueName: \"kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.000247 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.000207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.000420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.000263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk87q\" (UniqueName: \"kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.000839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.000819    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.008255 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.008232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk87q\" (UniqueName: \"kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q\") pod \"payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.037227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.037189    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.118099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.118003    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:32:31.120665 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:32:31.120637    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2993d25_4373_4c1b_aecf_fc44c9bdafc4.slice/crio-ee5fae1edd572501f9e08cef52c4ce0d95dac419781fcee384ac72b8873bd190 WatchSource:0}: Error finding container ee5fae1edd572501f9e08cef52c4ce0d95dac419781fcee384ac72b8873bd190: Status 404 returned error can't find the container with id ee5fae1edd572501f9e08cef52c4ce0d95dac419781fcee384ac72b8873bd190
Sep 15 21:32:31.304299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.304275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:32:31.306477 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:32:31.306447    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0984c6b6_17a3_46ca_b43c_04b7a075fdc7.slice/crio-f1fbe0946aa98041309bcc06d4dd842a925c05393dad2d068ba2e1657c2e5614 WatchSource:0}: Error finding container f1fbe0946aa98041309bcc06d4dd842a925c05393dad2d068ba2e1657c2e5614: Status 404 returned error can't find the container with id f1fbe0946aa98041309bcc06d4dd842a925c05393dad2d068ba2e1657c2e5614
Sep 15 21:32:31.378644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.378572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" event={"ID":"0984c6b6-17a3-46ca-b43c-04b7a075fdc7","Type":"ContainerStarted","Data":"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"}
Sep 15 21:32:31.378644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.378630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" event={"ID":"0984c6b6-17a3-46ca-b43c-04b7a075fdc7","Type":"ContainerStarted","Data":"f1fbe0946aa98041309bcc06d4dd842a925c05393dad2d068ba2e1657c2e5614"}
Sep 15 21:32:31.378838 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.378664    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:31.379903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.379880    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" event={"ID":"d2993d25-4373-4c1b-aecf-fc44c9bdafc4","Type":"ContainerStarted","Data":"ee5fae1edd572501f9e08cef52c4ce0d95dac419781fcee384ac72b8873bd190"}
Sep 15 21:32:31.394981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:31.394922    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" podStartSLOduration=1.394905818 podStartE2EDuration="1.394905818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:31.392720795 +0000 UTC m=+1347.000417886" watchObservedRunningTime="2026-09-15 21:32:31.394905818 +0000 UTC m=+1347.002602907"
Sep 15 21:32:32.386655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:32.386615    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" event={"ID":"d2993d25-4373-4c1b-aecf-fc44c9bdafc4","Type":"ContainerStarted","Data":"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"}
Sep 15 21:32:32.387054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:32.386711    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:32.405323 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:32.405269    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" podStartSLOduration=3.07008893 podStartE2EDuration="3.405251791s" totalImagesPullingTime="335.162861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:32:32.403604464 +0000 UTC m=+1348.011301552" watchObservedRunningTime="2026-09-15 21:32:32.405251791 +0000 UTC m=+1348.012948897"
Sep 15 21:32:38.397105 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:38.397073    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:32:42.388594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:42.388558    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:32:50.012351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:50.012312    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:32:52.055092 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:52.055032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:52.934318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:52.934289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:53.615537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:53.615509    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:54.301443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:54.301407    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:54.806545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:54.806514    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:55.154253 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:55.154157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:55.893053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:55.892995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:56.577278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:56.577248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:32:57.355807 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:32:57.355772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:09.209756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:09.209722    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:11.606984 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:11.606934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:15.814102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:15.814069    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:16.626262 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:16.626227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:17.325827 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:17.325790    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:17.994501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:17.994471    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:19.393113 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:19.393080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:19.693501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:19.693413    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:20.445506 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:20.445478    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:21.253647 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:21.253616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:22.026419 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:22.026389    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:26.810706 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:26.810676    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:33:28.726208 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:28.726173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.102235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.102202    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:33:31.102632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.102406    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" podUID="33071570-ca1b-4f62-aab7-300016c0d29f" containerName="maas-api" containerID="cri-o://eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6" gracePeriod=30
Sep 15 21:33:31.115517 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.115492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.156830 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.156787    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:33:31.157304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.157267    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" podUID="316beaca-359a-4e29-9268-fc7036035d20" containerName="payload-pre-processing" containerID="cri-o://cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb" gracePeriod=30
Sep 15 21:33:31.182561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.182534    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.246065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.246032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.324157 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.324121    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.381249 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.381227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:31.400855 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.400826    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:33:31.436410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.435762    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs\") pod \"33071570-ca1b-4f62-aab7-300016c0d29f\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") "
Sep 15 21:33:31.436410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.435822    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcqtc\" (UniqueName: \"kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc\") pod \"33071570-ca1b-4f62-aab7-300016c0d29f\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") "
Sep 15 21:33:31.436410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.435872    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca\") pod \"33071570-ca1b-4f62-aab7-300016c0d29f\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") "
Sep 15 21:33:31.436410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.435910    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") pod \"33071570-ca1b-4f62-aab7-300016c0d29f\" (UID: \"33071570-ca1b-4f62-aab7-300016c0d29f\") "
Sep 15 21:33:31.436705 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.436497    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33071570-ca1b-4f62-aab7-300016c0d29f" (UID: "33071570-ca1b-4f62-aab7-300016c0d29f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:33:31.439707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.439587    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc" (OuterVolumeSpecName: "kube-api-access-gcqtc") pod "33071570-ca1b-4f62-aab7-300016c0d29f" (UID: "33071570-ca1b-4f62-aab7-300016c0d29f"). InnerVolumeSpecName "kube-api-access-gcqtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:33:31.439707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.439664    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "33071570-ca1b-4f62-aab7-300016c0d29f" (UID: "33071570-ca1b-4f62-aab7-300016c0d29f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:33:31.439976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.439888    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33071570-ca1b-4f62-aab7-300016c0d29f" (UID: "33071570-ca1b-4f62-aab7-300016c0d29f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:33:31.445205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.445186    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:33:31.536633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536608    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume\") pod \"316beaca-359a-4e29-9268-fc7036035d20\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") "
Sep 15 21:33:31.536776 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536669    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnx78\" (UniqueName: \"kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78\") pod \"316beaca-359a-4e29-9268-fc7036035d20\" (UID: \"316beaca-359a-4e29-9268-fc7036035d20\") "
Sep 15 21:33:31.536849 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536839    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcqtc\" (UniqueName: \"kubernetes.io/projected/33071570-ca1b-4f62-aab7-300016c0d29f-kube-api-access-gcqtc\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.536894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536854    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33071570-ca1b-4f62-aab7-300016c0d29f-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.536894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536863    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.536894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.536873    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33071570-ca1b-4f62-aab7-300016c0d29f-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.537080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.537055    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "316beaca-359a-4e29-9268-fc7036035d20" (UID: "316beaca-359a-4e29-9268-fc7036035d20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:33:31.538767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.538746    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78" (OuterVolumeSpecName: "kube-api-access-tnx78") pod "316beaca-359a-4e29-9268-fc7036035d20" (UID: "316beaca-359a-4e29-9268-fc7036035d20"). InnerVolumeSpecName "kube-api-access-tnx78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:33:31.638227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.638176    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/316beaca-359a-4e29-9268-fc7036035d20-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.638227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.638195    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnx78\" (UniqueName: \"kubernetes.io/projected/316beaca-359a-4e29-9268-fc7036035d20-kube-api-access-tnx78\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:33:31.660346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.660318    2558 generic.go:356] "Generic (PLEG): container finished" podID="316beaca-359a-4e29-9268-fc7036035d20" containerID="cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb" exitCode=0
Sep 15 21:33:31.660443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.660367    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"
Sep 15 21:33:31.660443 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.660412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" event={"ID":"316beaca-359a-4e29-9268-fc7036035d20","Type":"ContainerDied","Data":"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"}
Sep 15 21:33:31.660551 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.660461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j" event={"ID":"316beaca-359a-4e29-9268-fc7036035d20","Type":"ContainerDied","Data":"63e1587a103b8cbcbf1e4fa6379d6374f1db770a7155a034295621a4e975f256"}
Sep 15 21:33:31.660551 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.660481    2558 scope.go:117] "RemoveContainer" containerID="cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"
Sep 15 21:33:31.661933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.661914    2558 generic.go:356] "Generic (PLEG): container finished" podID="33071570-ca1b-4f62-aab7-300016c0d29f" containerID="eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6" exitCode=0
Sep 15 21:33:31.662087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.661991    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"
Sep 15 21:33:31.662087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.661994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" event={"ID":"33071570-ca1b-4f62-aab7-300016c0d29f","Type":"ContainerDied","Data":"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"}
Sep 15 21:33:31.662087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.662050    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97" event={"ID":"33071570-ca1b-4f62-aab7-300016c0d29f","Type":"ContainerDied","Data":"76992975249d1436e0b0d6dd1bbb600c2c31c421df94e221f34623dfc5f307d6"}
Sep 15 21:33:31.670312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.670296    2558 scope.go:117] "RemoveContainer" containerID="cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"
Sep 15 21:33:31.670571 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:33:31.670553    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb\": container with ID starting with cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb not found: ID does not exist" containerID="cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"
Sep 15 21:33:31.670670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.670576    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb"} err="failed to get container status \"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb\": rpc error: code = NotFound desc = could not find container \"cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb\": container with ID starting with cd145a3a454afca67abf1b71f6aed7629b5aa1f0e441d0d930f67f0545a8c1fb not found: ID does not exist"
Sep 15 21:33:31.670670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.670593    2558 scope.go:117] "RemoveContainer" containerID="eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"
Sep 15 21:33:31.678148 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.678131    2558 scope.go:117] "RemoveContainer" containerID="eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"
Sep 15 21:33:31.678379 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:33:31.678362    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6\": container with ID starting with eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6 not found: ID does not exist" containerID="eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"
Sep 15 21:33:31.678423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.678384    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6"} err="failed to get container status \"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6\": rpc error: code = NotFound desc = could not find container \"eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6\": container with ID starting with eda00e92d56104c3ebbcdb20aedd74cec7bef545041fa8a3dcc5bf68710e43b6 not found: ID does not exist"
Sep 15 21:33:31.683253 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.683227    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:33:31.687107 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.687087    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d1980a0d-545ff688f8-vpn6j"]
Sep 15 21:33:31.698334 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.698308    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:33:31.705134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.705115    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d1980a0d-75bc87dd54-2rg97"]
Sep 15 21:33:31.821603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:31.821582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:32.533413 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:32.533377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:32.962466 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:32.962435    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="316beaca-359a-4e29-9268-fc7036035d20" path="/var/lib/kubelet/pods/316beaca-359a-4e29-9268-fc7036035d20/volumes"
Sep 15 21:33:32.962826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:32.962813    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33071570-ca1b-4f62-aab7-300016c0d29f" path="/var/lib/kubelet/pods/33071570-ca1b-4f62-aab7-300016c0d29f/volumes"
Sep 15 21:33:33.226257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:33.226154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:34.152453 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:34.152415    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:34.441826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:34.441740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:34.891883 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:34.891855    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:35.550249 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:35.550219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:36.374014 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:36.373985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:39.521031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:39.520995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:44.286580 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:44.286550    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:51.146260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:51.146228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:33:58.010677 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:33:58.010603    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:34:12.335710 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:12.335681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:16.190373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:16.190339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:17.049600 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:17.049568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:21.817332 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:21.817299    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:23.032934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:23.032901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:23.103426 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:23.103400    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:23.372328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:23.372255    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:24.566960 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:24.566911    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:24.663939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:24.663906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:24.855497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:24.855406    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:25.338676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:25.338642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:25.440411 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:25.440385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:25.539930 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:25.539901    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:26.714180 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:26.714147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:34:26.808969 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:26.808920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:26.909273 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:26.909244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:31.512018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:31.511985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:31.615244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:31.615218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:32.779075 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:32.779045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:32.885051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:32.885021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:33.453832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:33.453800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:39.386366 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:39.386335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:39.486614 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:39.486586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:39.586764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:39.586737    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:50.061306 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:50.061276    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:50.314928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:50.314850    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:56.620335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:56.620302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:34:59.205673 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:34:59.205638    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:35:07.219452 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:07.219426    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:11.212022 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:11.211989    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.561564 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:17.561527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.663553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:17.663522    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:17.891727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:17.891653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:18.157907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.157833    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:35:18.158198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158185    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33071570-ca1b-4f62-aab7-300016c0d29f" containerName="maas-api"
Sep 15 21:35:18.158244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158201    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="33071570-ca1b-4f62-aab7-300016c0d29f" containerName="maas-api"
Sep 15 21:35:18.158244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158211    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="316beaca-359a-4e29-9268-fc7036035d20" containerName="payload-pre-processing"
Sep 15 21:35:18.158244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158217    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="316beaca-359a-4e29-9268-fc7036035d20" containerName="payload-pre-processing"
Sep 15 21:35:18.158346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158276    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="316beaca-359a-4e29-9268-fc7036035d20" containerName="payload-pre-processing"
Sep 15 21:35:18.158346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.158286    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="33071570-ca1b-4f62-aab7-300016c0d29f" containerName="maas-api"
Sep 15 21:35:18.161089 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.161074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.164136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.164115    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d8f9d1-openshift-default-dockercfg-bh6pj\""
Sep 15 21:35:18.179430 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.179408    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:35:18.206664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.206646    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:18.276715 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nx8f\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.276836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.276836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.276836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.277120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.277120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.277120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.276976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.277120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.277001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.277120 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.277026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.306490 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.306463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:18.377675 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nx8f\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377675 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.377939 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.377985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.378520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.378440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.380271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.380251    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.380528 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.380509    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.389491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.389471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.389491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.389485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nx8f\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f\") pod \"e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") " pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.470687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.470670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:18.748670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.748648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:35:18.750745 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:35:18.750717    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e926388_8dc9_4de4_8b39_bf34d717f2cb.slice/crio-be3444b1c6cdb8943fb8295e944321a36d291353727dc260582572ccde95e1cd WatchSource:0}: Error finding container be3444b1c6cdb8943fb8295e944321a36d291353727dc260582572ccde95e1cd: Status 404 returned error can't find the container with id be3444b1c6cdb8943fb8295e944321a36d291353727dc260582572ccde95e1cd
Sep 15 21:35:18.753001 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.752925    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:35:18.753091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.753036    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:35:18.753091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:18.753065    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:35:19.136258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:19.136164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerStarted","Data":"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"}
Sep 15 21:35:19.136258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:19.136240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerStarted","Data":"be3444b1c6cdb8943fb8295e944321a36d291353727dc260582572ccde95e1cd"}
Sep 15 21:35:19.158412 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:19.158366    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podStartSLOduration=1.158352091 podStartE2EDuration="1.158352091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:35:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:35:19.156798755 +0000 UTC m=+1514.764495846" watchObservedRunningTime="2026-09-15 21:35:19.158352091 +0000 UTC m=+1514.766049180"
Sep 15 21:35:19.471813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:19.471782    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:19.476587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:19.476561    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:20.140934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:20.140904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:20.141967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:20.141921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:35:20.370892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:20.370860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:21.096789 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:21.096710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:21.185820 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:21.185792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:21.563831 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:21.563795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:22.451340 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:22.451313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:23.200680 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:23.200648    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:24.157639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:24.157601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:24.890185 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:24.890146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:25.748413 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:25.748381    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:26.582034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:26.582005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:26.707730 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:26.707695    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:26.808246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:26.808215    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:27.122855 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.122819    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:27.218974 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.218932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:27.302833 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.302797    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:35:27.306257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.306241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.308482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.308462    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d8f9d1\""
Sep 15 21:35:27.308975 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.308935    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d8f9d1-dockercfg-9vwnb\""
Sep 15 21:35:27.317165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.317144    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:35:27.462335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.462308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt25f\" (UniqueName: \"kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.462480 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.462361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.563321 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.563292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt25f\" (UniqueName: \"kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.563450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.563339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.563997 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.563975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.573224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.573199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt25f\" (UniqueName: \"kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f\") pod \"payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.618102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.618071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:27.887587 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:27.887563    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:35:27.889339 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:35:27.889310    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d445890_6fbc_4a54_98a2_0b4344ce5824.slice/crio-ef16f8e850d8637af16be82af92b4320796c28f897bbd186967c5b5e55ede0b5 WatchSource:0}: Error finding container ef16f8e850d8637af16be82af92b4320796c28f897bbd186967c5b5e55ede0b5: Status 404 returned error can't find the container with id ef16f8e850d8637af16be82af92b4320796c28f897bbd186967c5b5e55ede0b5
Sep 15 21:35:28.180019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:28.179920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" event={"ID":"8d445890-6fbc-4a54-98a2-0b4344ce5824","Type":"ContainerStarted","Data":"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"}
Sep 15 21:35:28.180173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:28.180022    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" event={"ID":"8d445890-6fbc-4a54-98a2-0b4344ce5824","Type":"ContainerStarted","Data":"ef16f8e850d8637af16be82af92b4320796c28f897bbd186967c5b5e55ede0b5"}
Sep 15 21:35:28.180173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:28.180078    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:28.198235 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:28.198189    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" podStartSLOduration=1.198172397 podStartE2EDuration="1.198172397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:35:28.196249012 +0000 UTC m=+1523.803946100" watchObservedRunningTime="2026-09-15 21:35:28.198172397 +0000 UTC m=+1523.805869530"
Sep 15 21:35:31.324178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:31.324147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:35:31.438093 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:31.438062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:39.185989 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:39.185938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:35:47.554367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:47.554332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:49.009105 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:49.009075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:49.374817 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:49.374739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:49.974476 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:49.974444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:50.742388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:50.742359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:51.286686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:51.286651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:51.654403 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:51.654326    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:51.756890 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:51.756860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:52.077486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:52.077446    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:52.177801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:52.177766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:52.482274 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:52.482247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:53.440089 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:53.440054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:54.255971 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:54.254075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:55.102404 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:55.102368    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:55.195207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:55.195177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:55.977518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:55.977458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:56.819393 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:56.819364    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:57.675669 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:57.675585    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:58.451233 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:58.451199    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:58.552350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:58.552316    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:58.653284 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:58.653229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:35:59.347115 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:35:59.347076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:00.171098 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.171062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:00.333218 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.333193    2558 generic.go:356] "Generic (PLEG): container finished" podID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerID="8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424" exitCode=0
Sep 15 21:36:00.333358 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.333255    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerDied","Data":"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"}
Sep 15 21:36:00.333691 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.333671    2558 scope.go:117] "RemoveContainer" containerID="8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"
Sep 15 21:36:00.335143 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.335112    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:36:00.335242 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.335220    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:36:00.335304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.335270    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 15 21:36:00.926641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:00.926607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:01.339665 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.339631    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerStarted","Data":"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"}
Sep 15 21:36:01.471486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.471458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:36:01.472271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.472250    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:01.472321 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.472295    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:01.863834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.863794    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:01.929744 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:01.929703    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:02.467451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.467417    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:36:02.470150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.470134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.471843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.471814    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:02.471972 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.471858    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:02.472834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.472813    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-119834\""
Sep 15 21:36:02.472879 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.472865    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-119834-dockercfg-84dct\""
Sep 15 21:36:02.482248 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.482226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:36:02.492198 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.492172    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:36:02.494531 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.494511    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.505696 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.505675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:36:02.555968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.555419    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.555968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.555514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwpg\" (UniqueName: \"kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.555968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.555546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwgr\" (UniqueName: \"kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.555968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.555577    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.657346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.657300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.658803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.658781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwpg\" (UniqueName: \"kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.659368 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.659339    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwgr\" (UniqueName: \"kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.659489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.658689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.659489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.659377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.660105 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.660087    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.667278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.667260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwgr\" (UniqueName: \"kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr\") pod \"payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") " pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:02.668096 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.668080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwpg\" (UniqueName: \"kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg\") pod \"payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.780520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.780426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:02.805756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:02.805721    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:03.072304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.072275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:36:03.074624 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:36:03.074597    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25ec4b8_aabc_45d1_88ee_f397d2537fa7.slice/crio-1d29fe955a090ba7061c35b806e6b7817b2ce0f35698a567d6676f0c7f8b67a7 WatchSource:0}: Error finding container 1d29fe955a090ba7061c35b806e6b7817b2ce0f35698a567d6676f0c7f8b67a7: Status 404 returned error can't find the container with id 1d29fe955a090ba7061c35b806e6b7817b2ce0f35698a567d6676f0c7f8b67a7
Sep 15 21:36:03.111378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.111357    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:36:03.113461 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:36:03.113426    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381639d9_c45b_4220_9bcf_c82599244db3.slice/crio-215dc51f268ecc986fc2009a7af9522e2f85544356a201de0ef24a9083ded3df WatchSource:0}: Error finding container 215dc51f268ecc986fc2009a7af9522e2f85544356a201de0ef24a9083ded3df: Status 404 returned error can't find the container with id 215dc51f268ecc986fc2009a7af9522e2f85544356a201de0ef24a9083ded3df
Sep 15 21:36:03.175646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.175616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:03.277263 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.277236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:03.362118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.361201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" event={"ID":"d25ec4b8-aabc-45d1-88ee-f397d2537fa7","Type":"ContainerStarted","Data":"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"}
Sep 15 21:36:03.362118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.361266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" event={"ID":"d25ec4b8-aabc-45d1-88ee-f397d2537fa7","Type":"ContainerStarted","Data":"1d29fe955a090ba7061c35b806e6b7817b2ce0f35698a567d6676f0c7f8b67a7"}
Sep 15 21:36:03.362118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.362005    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:03.366731 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.366398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" event={"ID":"381639d9-c45b-4220-9bcf-c82599244db3","Type":"ContainerStarted","Data":"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"}
Sep 15 21:36:03.366731 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.366445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" event={"ID":"381639d9-c45b-4220-9bcf-c82599244db3","Type":"ContainerStarted","Data":"215dc51f268ecc986fc2009a7af9522e2f85544356a201de0ef24a9083ded3df"}
Sep 15 21:36:03.366940 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.366918    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:03.412321 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.412285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:03.451970 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.451583    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" podStartSLOduration=1.451559617 podStartE2EDuration="1.451559617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:36:03.403008468 +0000 UTC m=+1559.010705555" watchObservedRunningTime="2026-09-15 21:36:03.451559617 +0000 UTC m=+1559.059256711"
Sep 15 21:36:03.451970 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.451697    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" podStartSLOduration=1.451688216 podStartE2EDuration="1.451688216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:36:03.433887416 +0000 UTC m=+1559.041584504" watchObservedRunningTime="2026-09-15 21:36:03.451688216 +0000 UTC m=+1559.059385305"
Sep 15 21:36:03.471908 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.471868    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:03.472354 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:03.471935    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:04.145161 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:04.145131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:04.471791 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:04.471759    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:04.471996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:04.471814    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:05.141268 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:05.141229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:36:05.227133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:05.227099    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:36:05.471773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:05.471739    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:05.471929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:05.471806    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:06.471578 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:06.471544    2558 patch_prober.go:28] interesting pod/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 15 21:36:06.471975 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:06.471596    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 15 21:36:07.475482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:07.475455    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:36:07.476488 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:07.476467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:36:10.828169 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:10.828131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:10.929183 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:10.929155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:15.377740 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:15.377712    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:36:15.378137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:15.377773    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:36:26.068628 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:26.068593    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:26.919650 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:26.919619    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:27.616981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:27.616930    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:28.421462 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:28.421428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:29.319676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:29.319640    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:30.082366 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:30.082333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:30.362144 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:30.362072    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:31.064094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:31.064064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:31.836024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:31.835993    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:32.697470 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:32.697440    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:33.724010 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:33.723975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:34.726594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:34.726560    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:35.578905 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:35.578875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:36.390152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:36.390118    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:37.256795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:37.256769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:38.414533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:38.414501    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:38.850380 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:38.850333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:39.667894 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:39.667843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:40.647566 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:40.647515    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:43.359895 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:43.359866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.025349 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.025313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.051027 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.050997    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:36:49.051294 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.051267    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerName="payload-pre-processing" containerID="cri-o://d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb" gracePeriod=30
Sep 15 21:36:49.094026 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.093992    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.185124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.185083    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.52:9004: connect: connection refused"
Sep 15 21:36:49.238652 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.238547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.330591 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.330562    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:36:49.337292 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.337271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.364313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.364270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt25f\" (UniqueName: \"kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f\") pod \"8d445890-6fbc-4a54-98a2-0b4344ce5824\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") "
Sep 15 21:36:49.364518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.364341    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume\") pod \"8d445890-6fbc-4a54-98a2-0b4344ce5824\" (UID: \"8d445890-6fbc-4a54-98a2-0b4344ce5824\") "
Sep 15 21:36:49.364892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.364858    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8d445890-6fbc-4a54-98a2-0b4344ce5824" (UID: "8d445890-6fbc-4a54-98a2-0b4344ce5824"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:36:49.366502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.366467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f" (OuterVolumeSpecName: "kube-api-access-tt25f") pod "8d445890-6fbc-4a54-98a2-0b4344ce5824" (UID: "8d445890-6fbc-4a54-98a2-0b4344ce5824"). InnerVolumeSpecName "kube-api-access-tt25f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:36:49.465333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.465288    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt25f\" (UniqueName: \"kubernetes.io/projected/8d445890-6fbc-4a54-98a2-0b4344ce5824-kube-api-access-tt25f\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:36:49.465333 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.465324    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8d445890-6fbc-4a54-98a2-0b4344ce5824-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:36:49.596996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.596882    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerID="d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb" exitCode=0
Sep 15 21:36:49.596996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.596928    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"
Sep 15 21:36:49.596996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.596975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" event={"ID":"8d445890-6fbc-4a54-98a2-0b4344ce5824","Type":"ContainerDied","Data":"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"}
Sep 15 21:36:49.597308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.597039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm" event={"ID":"8d445890-6fbc-4a54-98a2-0b4344ce5824","Type":"ContainerDied","Data":"ef16f8e850d8637af16be82af92b4320796c28f897bbd186967c5b5e55ede0b5"}
Sep 15 21:36:49.597308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.597079    2558 scope.go:117] "RemoveContainer" containerID="d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"
Sep 15 21:36:49.606178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.606161    2558 scope.go:117] "RemoveContainer" containerID="d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"
Sep 15 21:36:49.606465 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:36:49.606445    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb\": container with ID starting with d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb not found: ID does not exist" containerID="d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"
Sep 15 21:36:49.606519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.606472    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb"} err="failed to get container status \"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb\": rpc error: code = NotFound desc = could not find container \"d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb\": container with ID starting with d7e0a56d12d4ca2cfee2fa98c28808fa69ef673957eff26e68e2abff9b7cb3eb not found: ID does not exist"
Sep 15 21:36:49.617805 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.617778    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:36:49.622866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.622843    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d8f9d1-cdc45d698-szxdm"]
Sep 15 21:36:49.654339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.654312    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:49.715481 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:49.715449    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:50.424339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:50.424307    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:50.961929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:50.961897    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" path="/var/lib/kubelet/pods/8d445890-6fbc-4a54-98a2-0b4344ce5824/volumes"
Sep 15 21:36:51.432003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:51.431906    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:52.370484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:52.370451    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:53.271752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:53.271694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:54.199924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:54.199885    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:55.089753 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:55.089721    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:56.034093 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.034063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:56.736053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.736026    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:56.809345 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.809314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:56.965042 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.964961    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:36:56.965260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.965235    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy" containerID="cri-o://56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5" gracePeriod=30
Sep 15 21:36:56.990227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:56.990157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:58.185387 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:58.185354    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:58.898060 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:58.898006    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:36:59.744190 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:36:59.744155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:00.632762 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:00.632726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:01.560656 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:01.560627    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:02.210297 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.210263    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:37:02.280962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.280860    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.280962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.280898    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.280962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.280919    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.280962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.280940    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281011    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281047    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281202    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281249    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nx8f\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f\") pod \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\" (UID: \"5e926388-8dc9-4de4-8b39-bf34d717f2cb\") "
Sep 15 21:37:02.281314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281294    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:02.281615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281314    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:02.281615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:02.281615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281516    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:02.281615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281533    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:02.281818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281617    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.281818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281640    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.281818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.281654    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.283295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.283266    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:02.283295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.283270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f" (OuterVolumeSpecName: "kube-api-access-7nx8f") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "kube-api-access-7nx8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:02.283471 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.283446    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:37:02.283566 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.283550    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e926388-8dc9-4de4-8b39-bf34d717f2cb" (UID: "5e926388-8dc9-4de4-8b39-bf34d717f2cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:02.301189 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.301161    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:02.382553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382523    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.382553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382550    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.382553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382560    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nx8f\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-kube-api-access-7nx8f\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.382774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382570    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.382774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382578    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.382774 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.382586    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e926388-8dc9-4de4-8b39-bf34d717f2cb-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:02.658841 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.658762    2558 generic.go:356] "Generic (PLEG): container finished" podID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerID="56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5" exitCode=0
Sep 15 21:37:02.658841 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.658811    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"
Sep 15 21:37:02.659272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.658842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerDied","Data":"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"}
Sep 15 21:37:02.659272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.658899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m" event={"ID":"5e926388-8dc9-4de4-8b39-bf34d717f2cb","Type":"ContainerDied","Data":"be3444b1c6cdb8943fb8295e944321a36d291353727dc260582572ccde95e1cd"}
Sep 15 21:37:02.659272 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.658930    2558 scope.go:117] "RemoveContainer" containerID="56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"
Sep 15 21:37:02.670460 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.670439    2558 scope.go:117] "RemoveContainer" containerID="8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"
Sep 15 21:37:02.678496 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.678481    2558 scope.go:117] "RemoveContainer" containerID="56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"
Sep 15 21:37:02.678745 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:02.678727    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5\": container with ID starting with 56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5 not found: ID does not exist" containerID="56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"
Sep 15 21:37:02.678806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.678752    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5"} err="failed to get container status \"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5\": rpc error: code = NotFound desc = could not find container \"56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5\": container with ID starting with 56eb76f05e51657068f9f8696afbb83a802eefbb5520821e427c1827b209c8d5 not found: ID does not exist"
Sep 15 21:37:02.678806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.678768    2558 scope.go:117] "RemoveContainer" containerID="8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"
Sep 15 21:37:02.679019 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:02.679000    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424\": container with ID starting with 8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424 not found: ID does not exist" containerID="8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"
Sep 15 21:37:02.679080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.679029    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424"} err="failed to get container status \"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424\": rpc error: code = NotFound desc = could not find container \"8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424\": container with ID starting with 8ab7400b000ee877dd653fce233d8abaa4a0f4cb47648d26675c170fa189a424 not found: ID does not exist"
Sep 15 21:37:02.684384 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.684363    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:37:02.689480 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.689460    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d8f9d1-openshift-default-77847ccdb4-bwj5m"]
Sep 15 21:37:02.963228 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:02.963203    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" path="/var/lib/kubelet/pods/5e926388-8dc9-4de4-8b39-bf34d717f2cb/volumes"
Sep 15 21:37:03.053387 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:03.053359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:04.060985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:04.060935    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:12.858260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.858232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:12.886137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.886109    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:37:12.886374 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.886350    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" podUID="381639d9-c45b-4220-9bcf-c82599244db3" containerName="payload-processing" containerID="cri-o://a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee" gracePeriod=30
Sep 15 21:37:12.893993 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.893969    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:37:12.894171 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.894150    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" podUID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" containerName="payload-pre-processing" containerID="cri-o://54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59" gracePeriod=30
Sep 15 21:37:12.998127 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:12.998099    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.083658 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.083601    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.149614 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.149594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.166258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.166232    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:37:13.168196 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.168179    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:37:13.229748 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.229717    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.282489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.282460    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qwpg\" (UniqueName: \"kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg\") pod \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") "
Sep 15 21:37:13.282686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.282527    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzwgr\" (UniqueName: \"kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr\") pod \"381639d9-c45b-4220-9bcf-c82599244db3\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") "
Sep 15 21:37:13.282686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.282556    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume\") pod \"381639d9-c45b-4220-9bcf-c82599244db3\" (UID: \"381639d9-c45b-4220-9bcf-c82599244db3\") "
Sep 15 21:37:13.282686 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.282605    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume\") pod \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\" (UID: \"d25ec4b8-aabc-45d1-88ee-f397d2537fa7\") "
Sep 15 21:37:13.282903 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.282877    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "381639d9-c45b-4220-9bcf-c82599244db3" (UID: "381639d9-c45b-4220-9bcf-c82599244db3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:13.283054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.283017    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d25ec4b8-aabc-45d1-88ee-f397d2537fa7" (UID: "d25ec4b8-aabc-45d1-88ee-f397d2537fa7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:13.284639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.284616    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr" (OuterVolumeSpecName: "kube-api-access-zzwgr") pod "381639d9-c45b-4220-9bcf-c82599244db3" (UID: "381639d9-c45b-4220-9bcf-c82599244db3"). InnerVolumeSpecName "kube-api-access-zzwgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:13.284726 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.284666    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg" (OuterVolumeSpecName: "kube-api-access-4qwpg") pod "d25ec4b8-aabc-45d1-88ee-f397d2537fa7" (UID: "d25ec4b8-aabc-45d1-88ee-f397d2537fa7"). InnerVolumeSpecName "kube-api-access-4qwpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:13.384232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.384198    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzwgr\" (UniqueName: \"kubernetes.io/projected/381639d9-c45b-4220-9bcf-c82599244db3-kube-api-access-zzwgr\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:13.384232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.384231    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/381639d9-c45b-4220-9bcf-c82599244db3-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:13.384232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.384240    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:13.384394 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.384248    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qwpg\" (UniqueName: \"kubernetes.io/projected/d25ec4b8-aabc-45d1-88ee-f397d2537fa7-kube-api-access-4qwpg\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:13.458593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.458566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.558721 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.558689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:13.709866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.709780    2558 generic.go:356] "Generic (PLEG): container finished" podID="381639d9-c45b-4220-9bcf-c82599244db3" containerID="a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee" exitCode=0
Sep 15 21:37:13.709866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.709825    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"
Sep 15 21:37:13.710108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.709870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" event={"ID":"381639d9-c45b-4220-9bcf-c82599244db3","Type":"ContainerDied","Data":"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"}
Sep 15 21:37:13.710108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.709923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7" event={"ID":"381639d9-c45b-4220-9bcf-c82599244db3","Type":"ContainerDied","Data":"215dc51f268ecc986fc2009a7af9522e2f85544356a201de0ef24a9083ded3df"}
Sep 15 21:37:13.710108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.709970    2558 scope.go:117] "RemoveContainer" containerID="a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"
Sep 15 21:37:13.711385 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.711365    2558 generic.go:356] "Generic (PLEG): container finished" podID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" containerID="54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59" exitCode=0
Sep 15 21:37:13.711505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.711407    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"
Sep 15 21:37:13.711505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.711436    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" event={"ID":"d25ec4b8-aabc-45d1-88ee-f397d2537fa7","Type":"ContainerDied","Data":"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"}
Sep 15 21:37:13.711505 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.711485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs" event={"ID":"d25ec4b8-aabc-45d1-88ee-f397d2537fa7","Type":"ContainerDied","Data":"1d29fe955a090ba7061c35b806e6b7817b2ce0f35698a567d6676f0c7f8b67a7"}
Sep 15 21:37:13.720845 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.720827    2558 scope.go:117] "RemoveContainer" containerID="a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"
Sep 15 21:37:13.721202 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:13.721180    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee\": container with ID starting with a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee not found: ID does not exist" containerID="a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"
Sep 15 21:37:13.721279 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.721208    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee"} err="failed to get container status \"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee\": rpc error: code = NotFound desc = could not find container \"a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee\": container with ID starting with a1e90cb4c03395a3f6e57a8ec13d7705bc1b6320ba7f6fd3db7e21c5e06e50ee not found: ID does not exist"
Sep 15 21:37:13.721279 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.721224    2558 scope.go:117] "RemoveContainer" containerID="54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"
Sep 15 21:37:13.728325 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.728307    2558 scope.go:117] "RemoveContainer" containerID="54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"
Sep 15 21:37:13.728575 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:13.728559    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59\": container with ID starting with 54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59 not found: ID does not exist" containerID="54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"
Sep 15 21:37:13.728634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.728583    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59"} err="failed to get container status \"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59\": rpc error: code = NotFound desc = could not find container \"54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59\": container with ID starting with 54260e6fcb9a5205256ff7c7eb057b8b8493d795fe460fd4b5f316d42a8a8c59 not found: ID does not exist"
Sep 15 21:37:13.734635 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.734612    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:37:13.739553 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.739534    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-119834-68bb7f695c-sgjh7"]
Sep 15 21:37:13.749256 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.749235    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:37:13.755522 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:13.755502    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-119834-6d46c4f5f8-785cs"]
Sep 15 21:37:14.254797 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:14.254770    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:14.963610 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:14.963580    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381639d9-c45b-4220-9bcf-c82599244db3" path="/var/lib/kubelet/pods/381639d9-c45b-4220-9bcf-c82599244db3/volumes"
Sep 15 21:37:14.963928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:14.963915    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" path="/var/lib/kubelet/pods/d25ec4b8-aabc-45d1-88ee-f397d2537fa7/volumes"
Sep 15 21:37:14.999330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:14.999289    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:15.872372 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:15.872341    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:16.586209 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:16.586179    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:17.395407 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:17.395375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:18.143420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:18.143385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:18.865407 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:18.865375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:19.524909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:19.524873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:37:19.752130 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:19.752102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:19.853147 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:19.853067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:20.029358 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:20.029330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:20.679234 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:20.679198    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:21.471359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:21.471328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:22.186356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:22.186321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:22.980187 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:22.980152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:23.805836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:23.805805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:24.757133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:24.757102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:25.504040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:25.504010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:26.353761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:26.353731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:28.236748 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:28.236716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:28.339227 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:28.339190    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.006071 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.006041    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:37:31.006469 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.006256    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" podUID="2b55eefa-7268-407b-a005-7a2b44ff6a94" containerName="maas-api" containerID="cri-o://35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92" gracePeriod=30
Sep 15 21:37:31.035472 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.035438    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.108593 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.108551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.177658 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.177633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.245496 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.245459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.257682 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.257630    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:37:31.317572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.317535    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.444088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.444046    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsdjs\" (UniqueName: \"kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs\") pod \"2b55eefa-7268-407b-a005-7a2b44ff6a94\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") "
Sep 15 21:37:31.444088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.444090    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs\") pod \"2b55eefa-7268-407b-a005-7a2b44ff6a94\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") "
Sep 15 21:37:31.444335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.444187    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca\") pod \"2b55eefa-7268-407b-a005-7a2b44ff6a94\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") "
Sep 15 21:37:31.444335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.444221    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") pod \"2b55eefa-7268-407b-a005-7a2b44ff6a94\" (UID: \"2b55eefa-7268-407b-a005-7a2b44ff6a94\") "
Sep 15 21:37:31.444525 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.444499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b55eefa-7268-407b-a005-7a2b44ff6a94" (UID: "2b55eefa-7268-407b-a005-7a2b44ff6a94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:31.446278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.446247    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b55eefa-7268-407b-a005-7a2b44ff6a94" (UID: "2b55eefa-7268-407b-a005-7a2b44ff6a94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:31.446408 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.446258    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b55eefa-7268-407b-a005-7a2b44ff6a94" (UID: "2b55eefa-7268-407b-a005-7a2b44ff6a94"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:31.446804 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.446775    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs" (OuterVolumeSpecName: "kube-api-access-hsdjs") pod "2b55eefa-7268-407b-a005-7a2b44ff6a94" (UID: "2b55eefa-7268-407b-a005-7a2b44ff6a94"). InnerVolumeSpecName "kube-api-access-hsdjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:31.545455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.545365    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsdjs\" (UniqueName: \"kubernetes.io/projected/2b55eefa-7268-407b-a005-7a2b44ff6a94-kube-api-access-hsdjs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:31.545455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.545394    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:31.545455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.545403    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b55eefa-7268-407b-a005-7a2b44ff6a94-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:31.545455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.545413    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b55eefa-7268-407b-a005-7a2b44ff6a94-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:31.591743 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.591705    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.759290 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.759257    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:31.807260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.807184    2558 generic.go:356] "Generic (PLEG): container finished" podID="2b55eefa-7268-407b-a005-7a2b44ff6a94" containerID="35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92" exitCode=0
Sep 15 21:37:31.807260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.807230    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"
Sep 15 21:37:31.807425 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.807264    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" event={"ID":"2b55eefa-7268-407b-a005-7a2b44ff6a94","Type":"ContainerDied","Data":"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"}
Sep 15 21:37:31.807425 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.807319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2" event={"ID":"2b55eefa-7268-407b-a005-7a2b44ff6a94","Type":"ContainerDied","Data":"d25e107528766e899a9f1a074a7ca8b3de62b1e74a2d17fdc6c11899803e6ded"}
Sep 15 21:37:31.807425 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.807340    2558 scope.go:117] "RemoveContainer" containerID="35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"
Sep 15 21:37:31.821805 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.818804    2558 scope.go:117] "RemoveContainer" containerID="35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"
Sep 15 21:37:31.822529 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:31.822111    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92\": container with ID starting with 35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92 not found: ID does not exist" containerID="35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"
Sep 15 21:37:31.822529 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.822148    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92"} err="failed to get container status \"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92\": rpc error: code = NotFound desc = could not find container \"35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92\": container with ID starting with 35ce636dbf45fcfe8c87cb55f1d3b20d809d6a13164c2a93677c255fd200bd92 not found: ID does not exist"
Sep 15 21:37:31.832502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.832478    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:37:31.837142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:31.837120    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-dbcc8f-77db577755-bt5c2"]
Sep 15 21:37:32.649772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:32.649738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:32.962192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:32.962154    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b55eefa-7268-407b-a005-7a2b44ff6a94" path="/var/lib/kubelet/pods/2b55eefa-7268-407b-a005-7a2b44ff6a94/volumes"
Sep 15 21:37:33.524224 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:33.524166    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:34.352846 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:34.352810    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:35.133777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:35.133746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:35.872118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:35.872083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:37.938710 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:37.938681    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:38.015974 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:38.015920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:38.190834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:38.190756    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:37:38.191015 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:38.190992    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" containerID="cri-o://959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed" gracePeriod=30
Sep 15 21:37:38.221586 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:38.221555    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:38.718723 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:38.718695    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:39.646107 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:39.646078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:40.038304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:40.038277    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:40.496171 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:40.496141    2558 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 21:37:40.496309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:40.496194    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 21:37:40.747717 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:40.747636    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:41.484223 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:41.484188    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:42.359519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:42.359479    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:43.173399 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.173367    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:43.438777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.438753    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:37:43.550754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.550754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550800    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550822    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550846    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550869    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550900    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.550936    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7m4w\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551038 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551030    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket\") pod \"09746c22-a697-4208-9442-1381271d3860\" (UID: \"09746c22-a697-4208-9442-1381271d3860\") "
Sep 15 21:37:43.551390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:43.551390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data" (OuterVolumeSpecName: "istio-data") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:43.551390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551300    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:43.551555 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:43.551555 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.551469    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:43.553064 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.553030    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token" (OuterVolumeSpecName: "istio-token") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:43.553192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.553064    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:37:43.553192 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.553076    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:37:43.553287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.553196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w" (OuterVolumeSpecName: "kube-api-access-n7m4w") pod "09746c22-a697-4208-9442-1381271d3860" (UID: "09746c22-a697-4208-9442-1381271d3860"). InnerVolumeSpecName "kube-api-access-n7m4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:43.651659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651625    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651654    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651659 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651667    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651679    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09746c22-a697-4208-9442-1381271d3860-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651691    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651701    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651711    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09746c22-a697-4208-9442-1381271d3860-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651722    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09746c22-a697-4208-9442-1381271d3860-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.651893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.651733    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7m4w\" (UniqueName: \"kubernetes.io/projected/09746c22-a697-4208-9442-1381271d3860-kube-api-access-n7m4w\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:43.872040 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.872005    2558 generic.go:356] "Generic (PLEG): container finished" podID="09746c22-a697-4208-9442-1381271d3860" containerID="959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed" exitCode=0
Sep 15 21:37:43.872213 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.872055    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"
Sep 15 21:37:43.872213 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.872099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerDied","Data":"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"}
Sep 15 21:37:43.872213 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.872156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m" event={"ID":"09746c22-a697-4208-9442-1381271d3860","Type":"ContainerDied","Data":"89145c8b6bfcbc4cef7d911794fd2d8b533d93f15facfbff91eb4925c8f86939"}
Sep 15 21:37:43.872213 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.872182    2558 scope.go:117] "RemoveContainer" containerID="959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"
Sep 15 21:37:43.881193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.881177    2558 scope.go:117] "RemoveContainer" containerID="4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"
Sep 15 21:37:43.888636 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.888621    2558 scope.go:117] "RemoveContainer" containerID="959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"
Sep 15 21:37:43.888885 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:43.888862    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed\": container with ID starting with 959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed not found: ID does not exist" containerID="959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"
Sep 15 21:37:43.888973 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.888897    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed"} err="failed to get container status \"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed\": rpc error: code = NotFound desc = could not find container \"959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed\": container with ID starting with 959069cbcf5b95fc037dcba8c5140e599145640dfbcfd7fb8224d7cdae4b3bed not found: ID does not exist"
Sep 15 21:37:43.888973 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.888920    2558 scope.go:117] "RemoveContainer" containerID="4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"
Sep 15 21:37:43.889217 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:43.889200    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9\": container with ID starting with 4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9 not found: ID does not exist" containerID="4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"
Sep 15 21:37:43.889270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.889224    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9"} err="failed to get container status \"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9\": rpc error: code = NotFound desc = could not find container \"4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9\": container with ID starting with 4da8daab1acd79223774c4c65dd6840058f718c62e4c74108e55d132b1780dc9 not found: ID does not exist"
Sep 15 21:37:43.900033 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.900007    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:37:43.907832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.907812    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dbcc8f-openshift-default-58f57bdf4b-pcb2m"]
Sep 15 21:37:43.990126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:43.990100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:44.865400 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:44.865365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:44.962389 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:44.962355    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09746c22-a697-4208-9442-1381271d3860" path="/var/lib/kubelet/pods/09746c22-a697-4208-9442-1381271d3860/volumes"
Sep 15 21:37:45.119816 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:45.119735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:48.672414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:48.672380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.243060 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.243019    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:37:49.243237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.243217    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" podUID="0740bd59-09e2-4c60-bc51-9f848c737a3e" containerName="maas-api" containerID="cri-o://ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28" gracePeriod=30
Sep 15 21:37:49.269999 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.269975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.331330 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.331301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.389365 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.389339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.467170 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.467139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.487049 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.487026    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:37:49.532711 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.532645    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.604615 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.604584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs\") pod \"0740bd59-09e2-4c60-bc51-9f848c737a3e\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") "
Sep 15 21:37:49.604753 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.604643    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls\") pod \"0740bd59-09e2-4c60-bc51-9f848c737a3e\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") "
Sep 15 21:37:49.604753 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.604672    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca\") pod \"0740bd59-09e2-4c60-bc51-9f848c737a3e\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") "
Sep 15 21:37:49.604753 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.604748    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfggl\" (UniqueName: \"kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl\") pod \"0740bd59-09e2-4c60-bc51-9f848c737a3e\" (UID: \"0740bd59-09e2-4c60-bc51-9f848c737a3e\") "
Sep 15 21:37:49.605170 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.605144    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0740bd59-09e2-4c60-bc51-9f848c737a3e" (UID: "0740bd59-09e2-4c60-bc51-9f848c737a3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:49.606746 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.606720    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0740bd59-09e2-4c60-bc51-9f848c737a3e" (UID: "0740bd59-09e2-4c60-bc51-9f848c737a3e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:49.606836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.606781    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0740bd59-09e2-4c60-bc51-9f848c737a3e" (UID: "0740bd59-09e2-4c60-bc51-9f848c737a3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:49.606836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.606822    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl" (OuterVolumeSpecName: "kube-api-access-gfggl") pod "0740bd59-09e2-4c60-bc51-9f848c737a3e" (UID: "0740bd59-09e2-4c60-bc51-9f848c737a3e"). InnerVolumeSpecName "kube-api-access-gfggl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:49.705356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.705312    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfggl\" (UniqueName: \"kubernetes.io/projected/0740bd59-09e2-4c60-bc51-9f848c737a3e-kube-api-access-gfggl\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.705356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.705351    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.705356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.705364    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0740bd59-09e2-4c60-bc51-9f848c737a3e-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.705816 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.705377    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0740bd59-09e2-4c60-bc51-9f848c737a3e-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:49.823893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.823806    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:49.901435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.901394    2558 generic.go:356] "Generic (PLEG): container finished" podID="0740bd59-09e2-4c60-bc51-9f848c737a3e" containerID="ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28" exitCode=0
Sep 15 21:37:49.901611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.901442    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"
Sep 15 21:37:49.901611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.901464    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" event={"ID":"0740bd59-09e2-4c60-bc51-9f848c737a3e","Type":"ContainerDied","Data":"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"}
Sep 15 21:37:49.901611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.901516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862" event={"ID":"0740bd59-09e2-4c60-bc51-9f848c737a3e","Type":"ContainerDied","Data":"2c8266117ed0e1f828718054e259978d663f03ab7a2a03f84d6fccb1b8587979"}
Sep 15 21:37:49.901611 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.901546    2558 scope.go:117] "RemoveContainer" containerID="ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"
Sep 15 21:37:49.911080 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.911038    2558 scope.go:117] "RemoveContainer" containerID="ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"
Sep 15 21:37:49.911319 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:49.911294    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28\": container with ID starting with ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28 not found: ID does not exist" containerID="ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"
Sep 15 21:37:49.911370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.911333    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28"} err="failed to get container status \"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28\": rpc error: code = NotFound desc = could not find container \"ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28\": container with ID starting with ca882f697bd31b2a87a58a75c4d36293a83e754c78f4b5814d260a2803482a28 not found: ID does not exist"
Sep 15 21:37:49.924254 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.924233    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:37:49.930295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.930277    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-c39135-5866db97db-gv862"]
Sep 15 21:37:49.942207 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:49.942186    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:50.650184 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:50.650151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:50.962483 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:50.962451    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0740bd59-09e2-4c60-bc51-9f848c737a3e" path="/var/lib/kubelet/pods/0740bd59-09e2-4c60-bc51-9f848c737a3e/volumes"
Sep 15 21:37:51.455243 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:51.455164    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:52.174641 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:52.174607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:53.122138 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:53.122108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:53.310663 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:53.310628    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:37:55.699482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:55.699450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:55.762079 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:55.762052    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:55.931514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:55.931483    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:37:55.931701 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:55.931681    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy" containerID="cri-o://b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a" gracePeriod=30
Sep 15 21:37:55.944790 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:55.944763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:57.910295 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:57.910262    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:37:57.910737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:57.910509    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerName="maas-api" containerID="cri-o://a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb" gracePeriod=30
Sep 15 21:37:57.927496 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:57.927466    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.23:8443/health\": dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 15 21:37:57.950756 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:57.950729    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.060109 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.060083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.138214 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.138192    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:37:58.152839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.152814    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.255647 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.255614    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.277812 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.277778    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca\") pod \"b4081e10-3565-477f-8b0a-711f37d2ac89\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") "
Sep 15 21:37:58.277812 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.277806    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvkh7\" (UniqueName: \"kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7\") pod \"b4081e10-3565-477f-8b0a-711f37d2ac89\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") "
Sep 15 21:37:58.278054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.277832    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls\") pod \"b4081e10-3565-477f-8b0a-711f37d2ac89\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") "
Sep 15 21:37:58.278054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.277853    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs\") pod \"b4081e10-3565-477f-8b0a-711f37d2ac89\" (UID: \"b4081e10-3565-477f-8b0a-711f37d2ac89\") "
Sep 15 21:37:58.278222 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.278195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4081e10-3565-477f-8b0a-711f37d2ac89" (UID: "b4081e10-3565-477f-8b0a-711f37d2ac89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:37:58.280061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.280025    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4081e10-3565-477f-8b0a-711f37d2ac89" (UID: "b4081e10-3565-477f-8b0a-711f37d2ac89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:58.280061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.280053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b4081e10-3565-477f-8b0a-711f37d2ac89" (UID: "b4081e10-3565-477f-8b0a-711f37d2ac89"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:37:58.280228 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.280063    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7" (OuterVolumeSpecName: "kube-api-access-jvkh7") pod "b4081e10-3565-477f-8b0a-711f37d2ac89" (UID: "b4081e10-3565-477f-8b0a-711f37d2ac89"). InnerVolumeSpecName "kube-api-access-jvkh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:37:58.378865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.378833    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4081e10-3565-477f-8b0a-711f37d2ac89-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:58.378865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.378860    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvkh7\" (UniqueName: \"kubernetes.io/projected/b4081e10-3565-477f-8b0a-711f37d2ac89-kube-api-access-jvkh7\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:58.378865 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.378870    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:58.379112 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.378879    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4081e10-3565-477f-8b0a-711f37d2ac89-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:37:58.532936 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.532860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.676719 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.676673    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:37:58.944044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.943942    2558 generic.go:356] "Generic (PLEG): container finished" podID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerID="a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb" exitCode=0
Sep 15 21:37:58.944044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.944012    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"
Sep 15 21:37:58.944044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.944032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" event={"ID":"b4081e10-3565-477f-8b0a-711f37d2ac89","Type":"ContainerDied","Data":"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"}
Sep 15 21:37:58.944577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.944081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj" event={"ID":"b4081e10-3565-477f-8b0a-711f37d2ac89","Type":"ContainerDied","Data":"430e00aa3dec53863e53de8224c558557c3d3d6ce3b179ec3e64ba2cc878ca88"}
Sep 15 21:37:58.944577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.944097    2558 scope.go:117] "RemoveContainer" containerID="a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"
Sep 15 21:37:58.952976 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.952934    2558 scope.go:117] "RemoveContainer" containerID="a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"
Sep 15 21:37:58.953289 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:37:58.953265    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb\": container with ID starting with a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb not found: ID does not exist" containerID="a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"
Sep 15 21:37:58.953370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.953296    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb"} err="failed to get container status \"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb\": rpc error: code = NotFound desc = could not find container \"a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb\": container with ID starting with a41c5d0c54b1fc6b8492e8e2b21bbd9b6799e3dbca8925573a18abf2ec5264eb not found: ID does not exist"
Sep 15 21:37:58.965211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.965182    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:37:58.967024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:58.967004    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-318c22-f45db9c7f-82lhj"]
Sep 15 21:37:59.413931 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:37:59.413907    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:00.362349 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:00.362313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:00.961091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:00.961065    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" path="/var/lib/kubelet/pods/b4081e10-3565-477f-8b0a-711f37d2ac89/volumes"
Sep 15 21:38:01.083152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.083116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:01.180043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.180019    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:38:01.302621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302588    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302621    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302639    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mszwj\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302725    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302788    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.302823 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302810    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket\") pod \"22787044-1ce6-435e-a3b4-ad623a17b07f\" (UID: \"22787044-1ce6-435e-a3b4-ad623a17b07f\") "
Sep 15 21:38:01.303212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.302936    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:01.303212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.303117    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.303212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.303109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data" (OuterVolumeSpecName: "istio-data") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:01.303362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.303219    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:01.303362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.303293    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:01.303437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.303369    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:01.305252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.305225    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token" (OuterVolumeSpecName: "istio-token") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:01.305376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.305236    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:38:01.305376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.305326    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:38:01.305376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.305333    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj" (OuterVolumeSpecName: "kube-api-access-mszwj") pod "22787044-1ce6-435e-a3b4-ad623a17b07f" (UID: "22787044-1ce6-435e-a3b4-ad623a17b07f"). InnerVolumeSpecName "kube-api-access-mszwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:01.403779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403754    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.403779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403776    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403785    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mszwj\" (UniqueName: \"kubernetes.io/projected/22787044-1ce6-435e-a3b4-ad623a17b07f-kube-api-access-mszwj\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403793    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22787044-1ce6-435e-a3b4-ad623a17b07f-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403802    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403809    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403817    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.404173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.403824    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22787044-1ce6-435e-a3b4-ad623a17b07f-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:01.962793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.962757    2558 generic.go:356] "Generic (PLEG): container finished" podID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerID="b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a" exitCode=0
Sep 15 21:38:01.962938 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.962795    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"
Sep 15 21:38:01.962938 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.962840    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerDied","Data":"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"}
Sep 15 21:38:01.962938 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.962883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z" event={"ID":"22787044-1ce6-435e-a3b4-ad623a17b07f","Type":"ContainerDied","Data":"ee7584d2a120880946417bffada5e74811e72fda280374fccb53997169240821"}
Sep 15 21:38:01.962938 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.962905    2558 scope.go:117] "RemoveContainer" containerID="b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"
Sep 15 21:38:01.972163 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.972146    2558 scope.go:117] "RemoveContainer" containerID="bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"
Sep 15 21:38:01.979712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.979697    2558 scope.go:117] "RemoveContainer" containerID="b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"
Sep 15 21:38:01.979937 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:38:01.979919    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a\": container with ID starting with b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a not found: ID does not exist" containerID="b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"
Sep 15 21:38:01.980020 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.979957    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a"} err="failed to get container status \"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a\": rpc error: code = NotFound desc = could not find container \"b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a\": container with ID starting with b9c3e931114a77cc1975a3d8b12d9cf1bfd5a1db4646d00cfaeb4d936b386f2a not found: ID does not exist"
Sep 15 21:38:01.980020 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.979973    2558 scope.go:117] "RemoveContainer" containerID="bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"
Sep 15 21:38:01.980240 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:38:01.980223    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c\": container with ID starting with bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c not found: ID does not exist" containerID="bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"
Sep 15 21:38:01.980291 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.980246    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c"} err="failed to get container status \"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c\": rpc error: code = NotFound desc = could not find container \"bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c\": container with ID starting with bdf2618885de7932c334d12ca84a88e1c077014cddbf08df5e9077ac16f4727c not found: ID does not exist"
Sep 15 21:38:01.984124 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.984102    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:38:01.987857 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:01.987837    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-c39135-openshift-default-845c7cbffb-tc54z"]
Sep 15 21:38:02.965414 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:02.965378    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" path="/var/lib/kubelet/pods/22787044-1ce6-435e-a3b4-ad623a17b07f/volumes"
Sep 15 21:38:04.326445 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:04.326408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:04.426935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:04.426888    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:04.592589 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:04.592515    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:21.403482 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:21.403452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:21.664415 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:21.664323    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:21.764035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:21.764005    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:22.657083 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:22.657045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:24.100533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:24.100498    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:38:28.631733 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:28.631656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:28.883509 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:28.883432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:29.307783 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:29.307753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:30.011360 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:30.011295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:30.718319 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:30.718286    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:31.480246 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:31.480205    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:32.205133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:32.205078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:33.948491 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:33.948457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:36.642126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642092    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7854-529f8f"]
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642408    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" containerName="payload-pre-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642420    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" containerName="payload-pre-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642432    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381639d9-c45b-4220-9bcf-c82599244db3" containerName="payload-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642439    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="381639d9-c45b-4220-9bcf-c82599244db3" containerName="payload-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642448    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642454    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642462    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642467    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642475    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b55eefa-7268-407b-a005-7a2b44ff6a94" containerName="maas-api"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642482    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b55eefa-7268-407b-a005-7a2b44ff6a94" containerName="maas-api"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642490    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerName="payload-pre-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642495    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerName="payload-pre-processing"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642503    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.642501 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642508    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642518    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642523    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642530    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0740bd59-09e2-4c60-bc51-9f848c737a3e" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642534    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0740bd59-09e2-4c60-bc51-9f848c737a3e" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642540    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642545    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642590    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642598    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0740bd59-09e2-4c60-bc51-9f848c737a3e" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642602    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642610    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4081e10-3565-477f-8b0a-711f37d2ac89" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642615    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642620    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25ec4b8-aabc-45d1-88ee-f397d2537fa7" containerName="payload-pre-processing"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642625    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d445890-6fbc-4a54-98a2-0b4344ce5824" containerName="payload-pre-processing"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642630    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b55eefa-7268-407b-a005-7a2b44ff6a94" containerName="maas-api"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642634    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="09746c22-a697-4208-9442-1381271d3860" containerName="istio-proxy"
Sep 15 21:38:36.643019 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.642639    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="381639d9-c45b-4220-9bcf-c82599244db3" containerName="payload-processing"
Sep 15 21:38:36.645270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.645254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:38:36.647626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.647558    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ncvz5\""
Sep 15 21:38:36.650074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.650039    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7854-529f8f"]
Sep 15 21:38:36.685031 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.685004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6977\" (UniqueName: \"kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977\") pod \"test-curl-7854-529f8f\" (UID: \"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb\") " pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:38:36.785713 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.785687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6977\" (UniqueName: \"kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977\") pod \"test-curl-7854-529f8f\" (UID: \"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb\") " pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:38:36.793816 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.793788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6977\" (UniqueName: \"kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977\") pod \"test-curl-7854-529f8f\" (UID: \"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb\") " pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:38:36.956963 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:36.956895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:38:37.221632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:37.221610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7854-529f8f"]
Sep 15 21:38:37.223758 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:38:37.223729    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcc607d2_6f2c_4d52_9d37_ba143a91f5eb.slice/crio-4eec2a2e206ad8e14fa915cde210d9e0276373e28828467bd05b1782282b8c2a WatchSource:0}: Error finding container 4eec2a2e206ad8e14fa915cde210d9e0276373e28828467bd05b1782282b8c2a: Status 404 returned error can't find the container with id 4eec2a2e206ad8e14fa915cde210d9e0276373e28828467bd05b1782282b8c2a
Sep 15 21:38:37.225410 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:37.225393    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:38:38.116746 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:38.116715    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7854-529f8f" event={"ID":"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb","Type":"ContainerStarted","Data":"4eec2a2e206ad8e14fa915cde210d9e0276373e28828467bd05b1782282b8c2a"}
Sep 15 21:38:44.468640 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.468606    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:38:44.469086 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.468805    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" podUID="1eece173-dc16-481e-b5f1-c5ca210b5207" containerName="maas-api" containerID="cri-o://e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064" gracePeriod=30
Sep 15 21:38:44.494781 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.494753    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:44.525150 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.525124    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:38:44.525362 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.525339    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" podUID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" containerName="payload-processing" containerID="cri-o://5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1" gracePeriod=30
Sep 15 21:38:44.595620 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.595594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:44.697613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.697588    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:44.763692 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.763671    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:38:44.786035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.786008    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:44.793722 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.793698    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:38:44.814810 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.814782    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:38:44.845137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845109    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca\") pod \"1eece173-dc16-481e-b5f1-c5ca210b5207\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") "
Sep 15 21:38:44.845277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845150    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwcth\" (UniqueName: \"kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth\") pod \"1eece173-dc16-481e-b5f1-c5ca210b5207\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") "
Sep 15 21:38:44.845277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845181    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs\") pod \"1eece173-dc16-481e-b5f1-c5ca210b5207\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") "
Sep 15 21:38:44.845277 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845225    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxsjr\" (UniqueName: \"kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr\") pod \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") "
Sep 15 21:38:44.845447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume\") pod \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\" (UID: \"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f\") "
Sep 15 21:38:44.845447 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845335    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls\") pod \"1eece173-dc16-481e-b5f1-c5ca210b5207\" (UID: \"1eece173-dc16-481e-b5f1-c5ca210b5207\") "
Sep 15 21:38:44.845839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845612    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1eece173-dc16-481e-b5f1-c5ca210b5207" (UID: "1eece173-dc16-481e-b5f1-c5ca210b5207"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:44.845839 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.845717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" (UID: "8f27dbbf-5b40-4278-bc02-ffe15fe5c73f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:38:44.847707 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.847683    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth" (OuterVolumeSpecName: "kube-api-access-zwcth") pod "1eece173-dc16-481e-b5f1-c5ca210b5207" (UID: "1eece173-dc16-481e-b5f1-c5ca210b5207"). InnerVolumeSpecName "kube-api-access-zwcth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:44.847814 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.847714    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1eece173-dc16-481e-b5f1-c5ca210b5207" (UID: "1eece173-dc16-481e-b5f1-c5ca210b5207"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:38:44.847882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.847823    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr" (OuterVolumeSpecName: "kube-api-access-mxsjr") pod "8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" (UID: "8f27dbbf-5b40-4278-bc02-ffe15fe5c73f"). InnerVolumeSpecName "kube-api-access-mxsjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:38:44.847882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.847828    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1eece173-dc16-481e-b5f1-c5ca210b5207" (UID: "1eece173-dc16-481e-b5f1-c5ca210b5207"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:38:44.946409 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946382    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.946409 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946405    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxsjr\" (UniqueName: \"kubernetes.io/projected/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-kube-api-access-mxsjr\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.946538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946415    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.946538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946425    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eece173-dc16-481e-b5f1-c5ca210b5207-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.946538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946433    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eece173-dc16-481e-b5f1-c5ca210b5207-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:44.946538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:44.946442    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwcth\" (UniqueName: \"kubernetes.io/projected/1eece173-dc16-481e-b5f1-c5ca210b5207-kube-api-access-zwcth\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:38:45.100978 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.100899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:45.144350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.144324    2558 generic.go:356] "Generic (PLEG): container finished" podID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" containerID="5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1" exitCode=0
Sep 15 21:38:45.144461 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.144372    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"
Sep 15 21:38:45.144461 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.144399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" event={"ID":"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f","Type":"ContainerDied","Data":"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"}
Sep 15 21:38:45.144461 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.144443    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx" event={"ID":"8f27dbbf-5b40-4278-bc02-ffe15fe5c73f","Type":"ContainerDied","Data":"0dd00e15a78bf167c490e0e079803e0c0b5507b5485e10ac11958db254a83348"}
Sep 15 21:38:45.144621 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.144468    2558 scope.go:117] "RemoveContainer" containerID="5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"
Sep 15 21:38:45.145866 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.145844    2558 generic.go:356] "Generic (PLEG): container finished" podID="1eece173-dc16-481e-b5f1-c5ca210b5207" containerID="e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064" exitCode=0
Sep 15 21:38:45.145985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.145892    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"
Sep 15 21:38:45.145985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.145918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" event={"ID":"1eece173-dc16-481e-b5f1-c5ca210b5207","Type":"ContainerDied","Data":"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"}
Sep 15 21:38:45.145985 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.145979    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4" event={"ID":"1eece173-dc16-481e-b5f1-c5ca210b5207","Type":"ContainerDied","Data":"bef427bbde0a191222e9a7d8d2ada08934979e00d954f04632f136bbf2846a90"}
Sep 15 21:38:45.152594 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.152577    2558 scope.go:117] "RemoveContainer" containerID="5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"
Sep 15 21:38:45.152864 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:38:45.152848    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1\": container with ID starting with 5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1 not found: ID does not exist" containerID="5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"
Sep 15 21:38:45.152907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.152872    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1"} err="failed to get container status \"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1\": rpc error: code = NotFound desc = could not find container \"5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1\": container with ID starting with 5153371b5006c431156954603d983a60123dfae73e576757581f62b2ac1dbfe1 not found: ID does not exist"
Sep 15 21:38:45.152907 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.152888    2558 scope.go:117] "RemoveContainer" containerID="e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"
Sep 15 21:38:45.160717 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.160701    2558 scope.go:117] "RemoveContainer" containerID="e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"
Sep 15 21:38:45.161005 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:38:45.160978    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064\": container with ID starting with e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064 not found: ID does not exist" containerID="e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"
Sep 15 21:38:45.161077 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.161014    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064"} err="failed to get container status \"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064\": rpc error: code = NotFound desc = could not find container \"e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064\": container with ID starting with e298a7f019494c8fdbc3db84cecfea345f57323a9f584b659b60bb9f94ebd064 not found: ID does not exist"
Sep 15 21:38:45.161388 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.161371    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:38:45.167067 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.167046    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-6f66f7-79b6469457-8b9zx"]
Sep 15 21:38:45.178413 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.178392    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:38:45.181511 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.181492    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-6f66f7-565b9fd5-7czx4"]
Sep 15 21:38:45.188228 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.188208    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:45.850699 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:45.850621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:46.610125 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:46.610094    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:46.961695 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:46.961666    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eece173-dc16-481e-b5f1-c5ca210b5207" path="/var/lib/kubelet/pods/1eece173-dc16-481e-b5f1-c5ca210b5207/volumes"
Sep 15 21:38:46.962061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:46.962008    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" path="/var/lib/kubelet/pods/8f27dbbf-5b40-4278-bc02-ffe15fe5c73f/volumes"
Sep 15 21:38:50.893836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:50.893808    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:50.956247 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:50.956216    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:38:51.142042 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:38:51.142013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:03.225523 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:03.225480    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7854-529f8f" event={"ID":"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb","Type":"ContainerStarted","Data":"e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d"}
Sep 15 21:39:03.239771 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:03.239715    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7854-529f8f" podStartSLOduration=1.3354340630000001 podStartE2EDuration="27.239699417s" totalImagesPullingTime="25.904265354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:39:03.238851089 +0000 UTC m=+1738.846548178" watchObservedRunningTime="2026-09-15 21:39:03.239699417 +0000 UTC m=+1738.847396506"
Sep 15 21:39:03.823542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:03.823507    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7854-529f8f"]
Sep 15 21:39:03.829725 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:03.829694    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7854-529f8f"]
Sep 15 21:39:04.202562 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:04.202471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:39:04.229989 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:39:04.229963    2558 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7854-529f8f" container="test-curl-7854-529f8f"
Sep 15 21:39:05.234287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:05.234250    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7854-529f8f" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" containerName="test-curl-7854-529f8f" containerID="cri-o://e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d" gracePeriod=2
Sep 15 21:39:05.316908 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:05.316817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:06.715472 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:06.715419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:07.407386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:07.407364    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:39:07.518727 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:07.518664    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6977\" (UniqueName: \"kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977\") pod \"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb\" (UID: \"bcc607d2-6f2c-4d52-9d37-ba143a91f5eb\") "
Sep 15 21:39:07.520649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:07.520631    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977" (OuterVolumeSpecName: "kube-api-access-x6977") pod "bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" (UID: "bcc607d2-6f2c-4d52-9d37-ba143a91f5eb"). InnerVolumeSpecName "kube-api-access-x6977". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:39:07.619891 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:07.619866    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6977\" (UniqueName: \"kubernetes.io/projected/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb-kube-api-access-x6977\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:39:08.249826 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.249793    2558 generic.go:356] "Generic (PLEG): container finished" podID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" containerID="e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d" exitCode=137
Sep 15 21:39:08.250271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.249832    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:39:08.250271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.249882    2558 scope.go:117] "RemoveContainer" containerID="e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d"
Sep 15 21:39:08.257905 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.257888    2558 scope.go:117] "RemoveContainer" containerID="e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d"
Sep 15 21:39:08.258211 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:39:08.258194    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d\": container with ID starting with e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d not found: ID does not exist" containerID="e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d"
Sep 15 21:39:08.258286 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.258224    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d"} err="failed to get container status \"e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d\": rpc error: code = NotFound desc = could not find container \"e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d\": container with ID starting with e59ddb87a83f1fb102c3b4074af5cec72b709638f3012f885b6a5338a44afa1d not found: ID does not exist"
Sep 15 21:39:08.259956 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:39:08.259921    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7854-529f8f\" is forbidden: User \"system:node:ip-10-0-129-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-47.ec2.internal' and this object" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" pod="opendatahub/test-curl-7854-529f8f"
Sep 15 21:39:08.961821 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:08.961789    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" path="/var/lib/kubelet/pods/bcc607d2-6f2c-4d52-9d37-ba143a91f5eb/volumes"
Sep 15 21:39:10.812967 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:10.812919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:10.872196 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:10.872142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:11.925263 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:11.925231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:13.880542 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:13.880507    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:15.520462 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:15.520430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:39:21.140287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:21.140251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:24.231923 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:24.231886    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:39:26.370777 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:26.370746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:33.887635 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:33.887604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:39:38.486134 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:39:38.486098    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:10.548665 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:10.548634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:14.209680 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:14.209645    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:40:35.503110 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:35.503077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:40:51.410919 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:51.410889    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:40:53.648559 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:53.648529    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:40:54.705270 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:40:54.705238    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:00.241078 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:00.241033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:03.198393 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:03.198352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:41:28.937786 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:28.937689    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:41:32.114588 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:32.114556    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:41:47.409371 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:47.409332    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:41:56.409633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:41:56.409596    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:42:01.407180 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:01.407146    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:04.227076 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:04.226996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:05.713138 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:05.713088    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:06.388609 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:06.388566    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:06.480830 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:06.480796    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:06.905118 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:06.905082    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:42:07.343036 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:07.342997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.212423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212387    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212836    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212852    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212870    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212878    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212890    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" containerName="test-curl-7854-529f8f"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212900    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" containerName="test-curl-7854-529f8f"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212911    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eece173-dc16-481e-b5f1-c5ca210b5207" containerName="maas-api"
Sep 15 21:42:08.212913 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212920    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eece173-dc16-481e-b5f1-c5ca210b5207" containerName="maas-api"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212961    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" containerName="payload-processing"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.212970    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" containerName="payload-processing"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.213053    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22787044-1ce6-435e-a3b4-ad623a17b07f" containerName="istio-proxy"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.213065    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e926388-8dc9-4de4-8b39-bf34d717f2cb" containerName="istio-proxy"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.213076    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc607d2-6f2c-4d52-9d37-ba143a91f5eb" containerName="test-curl-7854-529f8f"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.213086    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f27dbbf-5b40-4278-bc02-ffe15fe5c73f" containerName="payload-processing"
Sep 15 21:42:08.213315 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.213096    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eece173-dc16-481e-b5f1-c5ca210b5207" containerName="maas-api"
Sep 15 21:42:08.216175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.216156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.218087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.218064    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-6d9d39-serving-cert\""
Sep 15 21:42:08.227047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.227022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:42:08.242434 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.242410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.243595 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.243569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.243708 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.243600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.243708 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.243634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7p2q\" (UniqueName: \"kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.243708 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.243674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.328424 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.328385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.344554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.344526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.344702 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.344568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.344779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.344760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.344858 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.344843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7p2q\" (UniqueName: \"kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.344913 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:42:08.344879    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-serving-cert: secret "maas-api-e2e-ipp-a-6d9d39-serving-cert" not found
Sep 15 21:42:08.344990 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:42:08.344967    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls podName:f6babd8f-def1-4afb-8dca-b03b03e0691c nodeName:}" failed. No retries permitted until 2026-09-15 21:42:08.844933915 +0000 UTC m=+1924.452630985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls") pod "maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" (UID: "f6babd8f-def1-4afb-8dca-b03b03e0691c") : secret "maas-api-e2e-ipp-a-6d9d39-serving-cert" not found
Sep 15 21:42:08.345237 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.345202    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.347093 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.347074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.355942 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.355915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7p2q\" (UniqueName: \"kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.510545 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.510450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.730584 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.730547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.833618 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.833510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:08.848647 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.848624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:08.851314 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:08.851287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:09.128638 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:09.128555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:09.397084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:09.397001    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:42:09.399976 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:42:09.399926    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6babd8f_def1_4afb_8dca_b03b03e0691c.slice/crio-dbc02b91e2094ff90c5385bb9e68ae403f62579ad8f205694b967823d8b9065c WatchSource:0}: Error finding container dbc02b91e2094ff90c5385bb9e68ae403f62579ad8f205694b967823d8b9065c: Status 404 returned error can't find the container with id dbc02b91e2094ff90c5385bb9e68ae403f62579ad8f205694b967823d8b9065c
Sep 15 21:42:10.019326 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:10.019283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" event={"ID":"f6babd8f-def1-4afb-8dca-b03b03e0691c","Type":"ContainerStarted","Data":"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"}
Sep 15 21:42:10.019521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:10.019341    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" event={"ID":"f6babd8f-def1-4afb-8dca-b03b03e0691c","Type":"ContainerStarted","Data":"dbc02b91e2094ff90c5385bb9e68ae403f62579ad8f205694b967823d8b9065c"}
Sep 15 21:42:10.019521 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:10.019423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:10.035660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:10.035608    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" podStartSLOduration=1.598797933 podStartE2EDuration="2.035594779s" totalImagesPullingTime="436.796846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:10.033831365 +0000 UTC m=+1925.641528475" watchObservedRunningTime="2026-09-15 21:42:10.035594779 +0000 UTC m=+1925.643291868"
Sep 15 21:42:16.028664 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:16.028632    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:42:18.712639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:18.712600    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:42:19.669152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:19.669117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:29.128856 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:29.128826    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:30.543924 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:30.543879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:31.347102 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:31.347071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:32.028800 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:32.028760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:33.050835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:33.050803    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:34.563206 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:34.563160    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:36.368057 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:36.368030    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:37.051787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:37.051749    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:37.403463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:37.403347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:37.985351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:37.985315    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:41.330928 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:41.330894    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:41.608421 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:41.608344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:41.704671 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:41.704639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:42.160179 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:42.160143    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:42.924764 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:42.924670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:42.986269 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:42.986237    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:43.064186 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.064151    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:43.167087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.167057    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:43.897595 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.897562    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:42:43.901500 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.901474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:43.903391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.903371    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-0da705-serving-cert\""
Sep 15 21:42:43.912435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.912401    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:42:43.985219 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:43.985181    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:44.044730 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.044697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.044898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.044745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv284\" (UniqueName: \"kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.044898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.044806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.044898 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.044825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.085761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.085728    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:44.145300 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.145265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.145457 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.145316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv284\" (UniqueName: \"kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.145457 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.145374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.145457 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.145404    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.146054 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.146031    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.147859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.147799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.147977 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.147863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.152597 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.152574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv284\" (UniqueName: \"kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284\") pod \"maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.186089 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.186063    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:44.214252 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.214226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:44.407012 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.406910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:44.484110 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.484078    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:42:44.486934 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.486904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:44.487281 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:42:44.487249    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8aa5a3d_e8b9_46d7_8137_cfda7cc7e647.slice/crio-c8ce6fb16e8bc2b4ed4a7f054a6a474d92e4940d3f42d9f8b21937785530653a WatchSource:0}: Error finding container c8ce6fb16e8bc2b4ed4a7f054a6a474d92e4940d3f42d9f8b21937785530653a: Status 404 returned error can't find the container with id c8ce6fb16e8bc2b4ed4a7f054a6a474d92e4940d3f42d9f8b21937785530653a
Sep 15 21:42:44.514884 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.514858    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:42:44.519299 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.519283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.521497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.521480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0da705-dockercfg-ht9xq\""
Sep 15 21:42:44.521573 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.521502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0da705\""
Sep 15 21:42:44.528579 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.528559    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:42:44.551267 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.549090    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:42:44.553887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.553862    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.559538 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.559507    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:42:44.652188 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.652156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.652188 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.652197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.652391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.652294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q55z\" (UniqueName: \"kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.652391 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.652335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxhrs\" (UniqueName: \"kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.752832 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.752794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.753046 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.752865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q55z\" (UniqueName: \"kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.753046 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.752888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxhrs\" (UniqueName: \"kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.753046 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.752920    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.753554 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.753532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.753606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.753589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.762802 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.762773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q55z\" (UniqueName: \"kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z\") pod \"payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:44.762911 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.762777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxhrs\" (UniqueName: \"kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs\") pod \"payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.830940 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.830901    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:44.865023 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:44.864988    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:45.100282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.100207    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:42:45.102849 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:42:45.102824    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bdffd2_c4fe_44b7_aa67_6d2b3a411f33.slice/crio-190df6edde9ec79620106a5b6ae585b508ad202968480883df42e1a97a50be6c WatchSource:0}: Error finding container 190df6edde9ec79620106a5b6ae585b508ad202968480883df42e1a97a50be6c: Status 404 returned error can't find the container with id 190df6edde9ec79620106a5b6ae585b508ad202968480883df42e1a97a50be6c
Sep 15 21:42:45.152603 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.152574    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:42:45.156180 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:42:45.156157    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2714d7_b5a3_46c9_b9b6_48c5bce0babb.slice/crio-73a081d694f707822f7505643eeb49054e40d2709ca84c1cbfc90e0f645870c0 WatchSource:0}: Error finding container 73a081d694f707822f7505643eeb49054e40d2709ca84c1cbfc90e0f645870c0: Status 404 returned error can't find the container with id 73a081d694f707822f7505643eeb49054e40d2709ca84c1cbfc90e0f645870c0
Sep 15 21:42:45.169752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.169726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" event={"ID":"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb","Type":"ContainerStarted","Data":"73a081d694f707822f7505643eeb49054e40d2709ca84c1cbfc90e0f645870c0"}
Sep 15 21:42:45.171524 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.171470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" event={"ID":"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647","Type":"ContainerStarted","Data":"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"}
Sep 15 21:42:45.171633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.171524    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" event={"ID":"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647","Type":"ContainerStarted","Data":"c8ce6fb16e8bc2b4ed4a7f054a6a474d92e4940d3f42d9f8b21937785530653a"}
Sep 15 21:42:45.171633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.171583    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:45.173583 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.173559    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" event={"ID":"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33","Type":"ContainerStarted","Data":"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"}
Sep 15 21:42:45.173698 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.173619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" event={"ID":"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33","Type":"ContainerStarted","Data":"190df6edde9ec79620106a5b6ae585b508ad202968480883df42e1a97a50be6c"}
Sep 15 21:42:45.173698 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.173652    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:45.188716 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.188658    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" podStartSLOduration=1.791452387 podStartE2EDuration="2.188641662s" totalImagesPullingTime="397.189275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:45.186137082 +0000 UTC m=+1960.793834170" watchObservedRunningTime="2026-09-15 21:42:45.188641662 +0000 UTC m=+1960.796338750"
Sep 15 21:42:45.201704 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:45.201660    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" podStartSLOduration=1.201644848 podStartE2EDuration="1.201644848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:45.200704808 +0000 UTC m=+1960.808401891" watchObservedRunningTime="2026-09-15 21:42:45.201644848 +0000 UTC m=+1960.809341936"
Sep 15 21:42:46.179342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:46.179307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" event={"ID":"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb","Type":"ContainerStarted","Data":"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"}
Sep 15 21:42:46.179797 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:46.179555    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:42:46.197746 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:46.197696    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" podStartSLOduration=2.197682414 podStartE2EDuration="2.197682414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:42:46.195723504 +0000 UTC m=+1961.803420595" watchObservedRunningTime="2026-09-15 21:42:46.197682414 +0000 UTC m=+1961.805379503"
Sep 15 21:42:47.509035 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:47.509001    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:42:51.185998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:51.185967    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:42:52.297010 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:52.296972    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:42:56.182114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:56.182083    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:42:57.186175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:42:57.186091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:43:04.793933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:04.793902    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:06.033331 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:06.033301    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:06.628338 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:06.628311    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:06.856364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:06.856329    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:07.575261 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:07.575229    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:08.257051 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:08.257021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:08.999792 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:08.999746    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:11.834795 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:11.834747    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq_1e2714d7-b5a3-46c9-b9b6-48c5bce0babb/payload-processing/0.log"
Sep 15 21:43:15.533287 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:15.533251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:19.412890 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:19.412854    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:43:31.803094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:31.803050    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:43:37.649735 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:37.649709    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq_1e2714d7-b5a3-46c9-b9b6-48c5bce0babb/payload-processing/0.log"
Sep 15 21:43:37.923867 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:37.923780    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:38.229450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:38.229402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:39.054463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:39.054431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:40.232281 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:40.232248    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:41.029767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:41.029739    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:41.126338 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:41.126297    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:41.868356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:41.868325    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:42.538801 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:42.538766    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:43.357101 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:43.357067    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:44.156408 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.156374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:44.255678 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.255644    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:44.542375 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.542345    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:44.630486 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.630455    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:43:44.714221 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.714178    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:43:44.717494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.717470    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.719365 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.719342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-a36624-dockercfg-chtd9\""
Sep 15 21:43:44.719473 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.719461    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-a36624\""
Sep 15 21:43:44.724998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.724939    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:43:44.870114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.870021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42vm\" (UniqueName: \"kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.870114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.870065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.970685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.970647    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.970864 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.970746    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42vm\" (UniqueName: \"kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.971364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.971344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:44.979350 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:44.979323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42vm\" (UniqueName: \"kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm\") pod \"payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:45.029304 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.029266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:45.302309 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.302269    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:43:45.305767 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:43:45.305739    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bbbbe8_8f5a_40ab_87a2_9ee18ba304e5.slice/crio-18e82d2b2f9b376b432bbce37e8e198ca34d6b8075d74d5f91f613633651958a WatchSource:0}: Error finding container 18e82d2b2f9b376b432bbce37e8e198ca34d6b8075d74d5f91f613633651958a: Status 404 returned error can't find the container with id 18e82d2b2f9b376b432bbce37e8e198ca34d6b8075d74d5f91f613633651958a
Sep 15 21:43:45.446175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.446136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" event={"ID":"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5","Type":"ContainerStarted","Data":"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"}
Sep 15 21:43:45.446395 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.446226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" event={"ID":"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5","Type":"ContainerStarted","Data":"18e82d2b2f9b376b432bbce37e8e198ca34d6b8075d74d5f91f613633651958a"}
Sep 15 21:43:45.446395 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.446284    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:43:45.463532 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:45.463464    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" podStartSLOduration=1.463444901 podStartE2EDuration="1.463444901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:43:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:43:45.463107788 +0000 UTC m=+2021.070804878" watchObservedRunningTime="2026-09-15 21:43:45.463444901 +0000 UTC m=+2021.071141991"
Sep 15 21:43:48.911023 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:48.910986    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:43:56.453572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:43:56.453537    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:44:06.928359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:06.928319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:07.724351 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:07.724321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:08.458274 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:08.458241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:09.108487 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:09.108450    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:09.901923 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:09.901886    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:10.574655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:10.574626    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:11.094632 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:11.094594    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:12.538115 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:12.538079    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:13.229601 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:13.229568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:14.014261 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:14.014231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:14.694343 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:14.694310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:15.366541 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:15.366510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:16.160916 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:16.160875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:22.649619 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.649587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:22.677334 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.677299    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:44:22.677968 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.677915    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" podUID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" containerName="payload-pre-processing" containerID="cri-o://a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6" gracePeriod=30
Sep 15 21:44:22.749584 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.749553    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:22.837168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.837135    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:22.904396 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.904309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:22.934586 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:22.934562    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:44:23.004566 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.004520    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume\") pod \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") "
Sep 15 21:44:23.004754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.004584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z42vm\" (UniqueName: \"kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm\") pod \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\" (UID: \"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5\") "
Sep 15 21:44:23.005043 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.005015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" (UID: "47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:23.006644 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.006624    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm" (OuterVolumeSpecName: "kube-api-access-z42vm") pod "47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" (UID: "47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5"). InnerVolumeSpecName "kube-api-access-z42vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:44:23.105489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.105440    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:23.105489 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.105483    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z42vm\" (UniqueName: \"kubernetes.io/projected/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5-kube-api-access-z42vm\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:23.207173 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.207089    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:23.310097 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.310062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:23.614435 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.614397    2558 generic.go:356] "Generic (PLEG): container finished" podID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" containerID="a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6" exitCode=0
Sep 15 21:44:23.614612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.614443    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"
Sep 15 21:44:23.614612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.614483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" event={"ID":"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5","Type":"ContainerDied","Data":"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"}
Sep 15 21:44:23.614612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.614533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8" event={"ID":"47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5","Type":"ContainerDied","Data":"18e82d2b2f9b376b432bbce37e8e198ca34d6b8075d74d5f91f613633651958a"}
Sep 15 21:44:23.614612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.614556    2558 scope.go:117] "RemoveContainer" containerID="a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"
Sep 15 21:44:23.624164 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.624143    2558 scope.go:117] "RemoveContainer" containerID="a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"
Sep 15 21:44:23.624560 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:44:23.624535    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6\": container with ID starting with a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6 not found: ID does not exist" containerID="a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"
Sep 15 21:44:23.624617 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.624574    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6"} err="failed to get container status \"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6\": rpc error: code = NotFound desc = could not find container \"a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6\": container with ID starting with a7abdefd0d3f6307300af9be99ec2576acdaaa3e24277d7e8b76d0a1832cadc6 not found: ID does not exist"
Sep 15 21:44:23.635676 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.635644    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:44:23.639940 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.639914    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a36624-f55d94bdb-7xhb8"]
Sep 15 21:44:23.955494 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:23.955385    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:24.737833 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:24.737800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:24.962229 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:24.962199    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" path="/var/lib/kubelet/pods/47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5/volumes"
Sep 15 21:44:25.508455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:25.508414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:26.197803 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:26.197771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:26.905186 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:26.905152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:44:29.329497 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:29.329463    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:29.430302 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:29.430272    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:29.594681 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:29.594582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:33.510317 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:33.510283    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:34.184088 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:34.184053    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:35.008868 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:35.008830    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:35.738214 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:35.738185    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:36.399827 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:36.399791    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:37.231929 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:37.231900    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:42.685690 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:42.685654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:46.301963 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:46.301917    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:44:47.275933 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:47.275898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:47.389104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:47.389070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:48.754384 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:48.754348    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:44:48.754872 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:48.754579    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" podUID="f6babd8f-def1-4afb-8dca-b03b03e0691c" containerName="maas-api" containerID="cri-o://27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3" gracePeriod=30
Sep 15 21:44:48.784504 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:48.784476    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:48.885211 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:48.885183    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:48.987744 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:48.987701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:49.013264 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.013201    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:44:49.084843 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.084809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:49.127794 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.127765    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7p2q\" (UniqueName: \"kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q\") pod \"f6babd8f-def1-4afb-8dca-b03b03e0691c\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") "
Sep 15 21:44:49.128009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.127816    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") pod \"f6babd8f-def1-4afb-8dca-b03b03e0691c\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") "
Sep 15 21:44:49.128009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.127901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs\") pod \"f6babd8f-def1-4afb-8dca-b03b03e0691c\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") "
Sep 15 21:44:49.128009 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.127924    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca\") pod \"f6babd8f-def1-4afb-8dca-b03b03e0691c\" (UID: \"f6babd8f-def1-4afb-8dca-b03b03e0691c\") "
Sep 15 21:44:49.128510 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.128477    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6babd8f-def1-4afb-8dca-b03b03e0691c" (UID: "f6babd8f-def1-4afb-8dca-b03b03e0691c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:44:49.130572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.130527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6babd8f-def1-4afb-8dca-b03b03e0691c" (UID: "f6babd8f-def1-4afb-8dca-b03b03e0691c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:44:49.130572 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.130549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6babd8f-def1-4afb-8dca-b03b03e0691c" (UID: "f6babd8f-def1-4afb-8dca-b03b03e0691c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:44:49.130709 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.130548    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q" (OuterVolumeSpecName: "kube-api-access-z7p2q") pod "f6babd8f-def1-4afb-8dca-b03b03e0691c" (UID: "f6babd8f-def1-4afb-8dca-b03b03e0691c"). InnerVolumeSpecName "kube-api-access-z7p2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:44:49.229149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.229116    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:49.229149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.229146    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6babd8f-def1-4afb-8dca-b03b03e0691c-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:49.229149 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.229157    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7p2q\" (UniqueName: \"kubernetes.io/projected/f6babd8f-def1-4afb-8dca-b03b03e0691c-kube-api-access-z7p2q\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:49.229390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.229166    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6babd8f-def1-4afb-8dca-b03b03e0691c-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:44:49.252800 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.252769    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:49.353412 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.353318    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:49.731274 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.731237    2558 generic.go:356] "Generic (PLEG): container finished" podID="f6babd8f-def1-4afb-8dca-b03b03e0691c" containerID="27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3" exitCode=0
Sep 15 21:44:49.731451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.731279    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"
Sep 15 21:44:49.731451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.731321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" event={"ID":"f6babd8f-def1-4afb-8dca-b03b03e0691c","Type":"ContainerDied","Data":"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"}
Sep 15 21:44:49.731451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.731370    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5" event={"ID":"f6babd8f-def1-4afb-8dca-b03b03e0691c","Type":"ContainerDied","Data":"dbc02b91e2094ff90c5385bb9e68ae403f62579ad8f205694b967823d8b9065c"}
Sep 15 21:44:49.731451 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.731396    2558 scope.go:117] "RemoveContainer" containerID="27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"
Sep 15 21:44:49.740253 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.740205    2558 scope.go:117] "RemoveContainer" containerID="27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"
Sep 15 21:44:49.740500 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:44:49.740475    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3\": container with ID starting with 27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3 not found: ID does not exist" containerID="27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"
Sep 15 21:44:49.740546 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.740513    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3"} err="failed to get container status \"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3\": rpc error: code = NotFound desc = could not find container \"27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3\": container with ID starting with 27d2b25dbb4d2781b40d8c9252d694682b7033d8487c2170832a933e7b79b3c3 not found: ID does not exist"
Sep 15 21:44:49.752479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.752458    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:44:49.756403 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:49.756382    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6d9d39-c8c74dcb6-x6cv5"]
Sep 15 21:44:50.097423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:50.097339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:50.773374 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:50.773342    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:50.962580 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:50.962548    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6babd8f-def1-4afb-8dca-b03b03e0691c" path="/var/lib/kubelet/pods/f6babd8f-def1-4afb-8dca-b03b03e0691c/volumes"
Sep 15 21:44:51.637405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:51.637374    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:54.380794 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:54.380760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:44:59.312846 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:44:59.312804    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:45:31.477687 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:31.477651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:31.609517 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:31.609488    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:37.167307 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:37.167274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:37.230263 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:37.230232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:37.440835 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:37.440759    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:37.955914 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:37.955884    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:38.850441 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:38.850408    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:39.513613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:39.513576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.191684 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:40.191653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:40.911631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:40.911596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:48.371378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.371343    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:45:48.371893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.371584    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" podUID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" containerName="maas-api" containerID="cri-o://b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0" gracePeriod=30
Sep 15 21:45:48.417271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.417241    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:48.425133 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.425101    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:45:48.425463 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.425331    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" podUID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" containerName="payload-processing" containerID="cri-o://52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989" gracePeriod=30
Sep 15 21:45:48.434793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.434608    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:45:48.434963 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.434810    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" podUID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" containerName="payload-pre-processing" containerID="cri-o://7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456" gracePeriod=30
Sep 15 21:45:48.518768 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.518738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:48.596606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.596531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:48.665152 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.665122    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:48.676348 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.676321    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:45:48.695606 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.695565    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:45:48.710024 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.709940    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:45:48.814171 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca\") pod \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") "
Sep 15 21:45:48.814364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814179    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume\") pod \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") "
Sep 15 21:45:48.814364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs\") pod \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") "
Sep 15 21:45:48.814364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxhrs\" (UniqueName: \"kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs\") pod \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") "
Sep 15 21:45:48.814364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814278    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume\") pod \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\" (UID: \"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33\") "
Sep 15 21:45:48.814364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814310    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls\") pod \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") "
Sep 15 21:45:48.814639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814388    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv284\" (UniqueName: \"kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284\") pod \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\" (UID: \"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647\") "
Sep 15 21:45:48.814639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814416    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q55z\" (UniqueName: \"kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z\") pod \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\" (UID: \"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb\") "
Sep 15 21:45:48.814639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814595    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" (UID: "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:48.814779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814663    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" (UID: "1e2714d7-b5a3-46c9-b9b6-48c5bce0babb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:48.814779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.814678    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.815091 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.815065    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" (UID: "f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:45:48.816386 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.816365    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" (UID: "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:45:48.816863 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.816829    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" (UID: "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:45:48.817003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.816897    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z" (OuterVolumeSpecName: "kube-api-access-2q55z") pod "1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" (UID: "1e2714d7-b5a3-46c9-b9b6-48c5bce0babb"). InnerVolumeSpecName "kube-api-access-2q55z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:48.817003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.816911    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs" (OuterVolumeSpecName: "kube-api-access-gxhrs") pod "f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" (UID: "f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33"). InnerVolumeSpecName "kube-api-access-gxhrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:48.817003 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.816920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284" (OuterVolumeSpecName: "kube-api-access-nv284") pod "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" (UID: "f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647"). InnerVolumeSpecName "kube-api-access-nv284". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915338    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915362    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxhrs\" (UniqueName: \"kubernetes.io/projected/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-kube-api-access-gxhrs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915372    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915380    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915389    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv284\" (UniqueName: \"kubernetes.io/projected/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647-kube-api-access-nv284\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915397    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q55z\" (UniqueName: \"kubernetes.io/projected/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-kube-api-access-2q55z\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.915417 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.915404    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:45:48.984655 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.984625    2558 generic.go:356] "Generic (PLEG): container finished" podID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" containerID="52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989" exitCode=0
Sep 15 21:45:48.984787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.984675    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"
Sep 15 21:45:48.984787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.984699    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" event={"ID":"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb","Type":"ContainerDied","Data":"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"}
Sep 15 21:45:48.984787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.984753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq" event={"ID":"1e2714d7-b5a3-46c9-b9b6-48c5bce0babb","Type":"ContainerDied","Data":"73a081d694f707822f7505643eeb49054e40d2709ca84c1cbfc90e0f645870c0"}
Sep 15 21:45:48.984787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.984782    2558 scope.go:117] "RemoveContainer" containerID="52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"
Sep 15 21:45:48.986094 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.986067    2558 generic.go:356] "Generic (PLEG): container finished" podID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" containerID="b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0" exitCode=0
Sep 15 21:45:48.986212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.986105    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"
Sep 15 21:45:48.986212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.986142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" event={"ID":"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647","Type":"ContainerDied","Data":"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"}
Sep 15 21:45:48.986212 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.986193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq" event={"ID":"f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647","Type":"ContainerDied","Data":"c8ce6fb16e8bc2b4ed4a7f054a6a474d92e4940d3f42d9f8b21937785530653a"}
Sep 15 21:45:48.987771 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.987747    2558 generic.go:356] "Generic (PLEG): container finished" podID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" containerID="7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456" exitCode=0
Sep 15 21:45:48.987887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.987792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"
Sep 15 21:45:48.987887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.987825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" event={"ID":"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33","Type":"ContainerDied","Data":"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"}
Sep 15 21:45:48.987887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.987870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz" event={"ID":"f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33","Type":"ContainerDied","Data":"190df6edde9ec79620106a5b6ae585b508ad202968480883df42e1a97a50be6c"}
Sep 15 21:45:48.993543 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.993524    2558 scope.go:117] "RemoveContainer" containerID="52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"
Sep 15 21:45:48.993768 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:45:48.993753    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989\": container with ID starting with 52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989 not found: ID does not exist" containerID="52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"
Sep 15 21:45:48.993822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.993774    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989"} err="failed to get container status \"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989\": rpc error: code = NotFound desc = could not find container \"52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989\": container with ID starting with 52a7da8070cd7970219bfa4b4193868e0ecd8f6fb577afddacdb6f3dc8778989 not found: ID does not exist"
Sep 15 21:45:48.993822 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:48.993790    2558 scope.go:117] "RemoveContainer" containerID="b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"
Sep 15 21:45:49.001318 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.001301    2558 scope.go:117] "RemoveContainer" containerID="b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"
Sep 15 21:45:49.001561 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:45:49.001540    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0\": container with ID starting with b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0 not found: ID does not exist" containerID="b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"
Sep 15 21:45:49.001613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.001568    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0"} err="failed to get container status \"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0\": rpc error: code = NotFound desc = could not find container \"b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0\": container with ID starting with b356e8cbec8a9d2279903a5bb968f16788efe37c98dae2bd4bca079947a021f0 not found: ID does not exist"
Sep 15 21:45:49.001613 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.001590    2558 scope.go:117] "RemoveContainer" containerID="7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"
Sep 15 21:45:49.006400 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.006379    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:49.008904 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.008881    2558 scope.go:117] "RemoveContainer" containerID="7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"
Sep 15 21:45:49.009178 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:45:49.009159    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456\": container with ID starting with 7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456 not found: ID does not exist" containerID="7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"
Sep 15 21:45:49.009258 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.009186    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456"} err="failed to get container status \"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456\": rpc error: code = NotFound desc = could not find container \"7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456\": container with ID starting with 7221da5ffe342b9e32c8609db510c3c8c2902b204ae76ce867e7a814d07a9456 not found: ID does not exist"
Sep 15 21:45:49.011157 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.011132    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:45:49.013420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.013399    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0da705-6546d886d5-z9lpq"]
Sep 15 21:45:49.023160 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.023124    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:45:49.024357 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.024341    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0da705-5667b994d7-n7qgq"]
Sep 15 21:45:49.034206 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.034185    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:45:49.036004 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.035982    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0da705-7b7f45b4c4-qdmgz"]
Sep 15 21:45:49.105633 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.105595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:49.734171 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:49.734145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:50.443136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:50.443100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:50.961705 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:50.961673    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" path="/var/lib/kubelet/pods/1e2714d7-b5a3-46c9-b9b6-48c5bce0babb/volumes"
Sep 15 21:45:50.962099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:50.962082    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" path="/var/lib/kubelet/pods/f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33/volumes"
Sep 15 21:45:50.962453 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:50.962441    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" path="/var/lib/kubelet/pods/f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647/volumes"
Sep 15 21:45:51.702086 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:51.702051    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:45:52.162371 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:52.162339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:52.262996 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:52.262962    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:54.873784 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:54.873757    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:54.927728 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:54.927700    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:55.144901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:55.144822    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:55.835178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:55.835142    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:56.615097 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:56.615061    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:57.285236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:57.285193    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:45:58.017663 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:45:58.017633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:04.489481 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:04.489428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:05.721178 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:05.721136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:06.364023 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.363984    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:06.391271 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.391238    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:46:06.391738 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.391703    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" podUID="5841a94e-8478-4508-90db-5992dcaf3fae" containerName="payload-processing" containerID="cri-o://2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b" gracePeriod=30
Sep 15 21:46:06.462467 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.462442    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:06.555526 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.555494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:06.614319 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.614244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:06.650014 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.649993    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:46:06.767074 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.767036    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbzj7\" (UniqueName: \"kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7\") pod \"5841a94e-8478-4508-90db-5992dcaf3fae\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") "
Sep 15 21:46:06.767437 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.767103    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume\") pod \"5841a94e-8478-4508-90db-5992dcaf3fae\" (UID: \"5841a94e-8478-4508-90db-5992dcaf3fae\") "
Sep 15 21:46:06.767484 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.767465    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5841a94e-8478-4508-90db-5992dcaf3fae" (UID: "5841a94e-8478-4508-90db-5992dcaf3fae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:06.769193 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.769171    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7" (OuterVolumeSpecName: "kube-api-access-rbzj7") pod "5841a94e-8478-4508-90db-5992dcaf3fae" (UID: "5841a94e-8478-4508-90db-5992dcaf3fae"). InnerVolumeSpecName "kube-api-access-rbzj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:06.867779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.867693    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbzj7\" (UniqueName: \"kubernetes.io/projected/5841a94e-8478-4508-90db-5992dcaf3fae-kube-api-access-rbzj7\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:06.867779 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.867724    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5841a94e-8478-4508-90db-5992dcaf3fae-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:06.968767 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:06.968733    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:07.032921 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.032881    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:07.067050 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.066938    2558 generic.go:356] "Generic (PLEG): container finished" podID="5841a94e-8478-4508-90db-5992dcaf3fae" containerID="2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b" exitCode=0
Sep 15 21:46:07.067050 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.067021    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"
Sep 15 21:46:07.067050 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.067043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" event={"ID":"5841a94e-8478-4508-90db-5992dcaf3fae","Type":"ContainerDied","Data":"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"}
Sep 15 21:46:07.067282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.067099    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht" event={"ID":"5841a94e-8478-4508-90db-5992dcaf3fae","Type":"ContainerDied","Data":"11b079e4f214be4a7525d1e0b25d4d2b474072a8c2a999060ff828aecbf38f72"}
Sep 15 21:46:07.067282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.067122    2558 scope.go:117] "RemoveContainer" containerID="2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"
Sep 15 21:46:07.075021 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.075002    2558 scope.go:117] "RemoveContainer" containerID="2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"
Sep 15 21:46:07.075296 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:46:07.075273    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b\": container with ID starting with 2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b not found: ID does not exist" containerID="2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"
Sep 15 21:46:07.075339 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.075303    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b"} err="failed to get container status \"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b\": rpc error: code = NotFound desc = could not find container \"2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b\": container with ID starting with 2cda47a28f98ece56d61638d9d9bcb6d969ad4155ee976a377d485c0439a784b not found: ID does not exist"
Sep 15 21:46:07.085367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.085338    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:46:07.088824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.088800    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f36399-66476d5f9f-7pnht"]
Sep 15 21:46:07.712165 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:07.712123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:08.962137 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:08.962104    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5841a94e-8478-4508-90db-5992dcaf3fae" path="/var/lib/kubelet/pods/5841a94e-8478-4508-90db-5992dcaf3fae/volumes"
Sep 15 21:46:09.298373 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:09.298293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:46:12.828202 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:12.828168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:12.880332 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:12.880288    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:13.093126 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:13.093034    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:46:13.093313 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:13.093251    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy" containerID="cri-o://8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445" gracePeriod=30
Sep 15 21:46:13.116962 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:13.116920    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:14.356034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:14.355999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:15.037086 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:15.037052    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:18.327114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.327091    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:46:18.455312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455228    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455267    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455291    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455312 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455475    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455509    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455543    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455566    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455612 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455601    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mldt\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt\") pod \"fead5e95-5c0e-4761-8b52-9af0a0b28328\" (UID: \"fead5e95-5c0e-4761-8b52-9af0a0b28328\") "
Sep 15 21:46:18.455870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455558    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:46:18.455870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455757    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data" (OuterVolumeSpecName: "istio-data") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:46:18.455870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:46:18.455870 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455829    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:46:18.456084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455921    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-data\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.456084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455932    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:18.456084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.455940    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-credential-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.456084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.456014    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.456084 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.456030    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-workload-socket\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.457650 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.457627    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 21:46:18.457765 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.457652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 21:46:18.457836 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.457808    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token" (OuterVolumeSpecName: "istio-token") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:18.457881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.457857    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt" (OuterVolumeSpecName: "kube-api-access-9mldt") pod "fead5e95-5c0e-4761-8b52-9af0a0b28328" (UID: "fead5e95-5c0e-4761-8b52-9af0a0b28328"). InnerVolumeSpecName "kube-api-access-9mldt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:18.556519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.556476    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-token\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.556519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.556515    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-podinfo\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.556519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.556526    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fead5e95-5c0e-4761-8b52-9af0a0b28328-istio-envoy\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.556519 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.556534    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fead5e95-5c0e-4761-8b52-9af0a0b28328-istiod-ca-cert\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:18.556787 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:18.556542    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mldt\" (UniqueName: \"kubernetes.io/projected/fead5e95-5c0e-4761-8b52-9af0a0b28328-kube-api-access-9mldt\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:19.126184 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.126140    2558 generic.go:356] "Generic (PLEG): container finished" podID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerID="8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445" exitCode=0
Sep 15 21:46:19.126346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.126190    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"
Sep 15 21:46:19.126346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.126226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerDied","Data":"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"}
Sep 15 21:46:19.126346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.126283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv" event={"ID":"fead5e95-5c0e-4761-8b52-9af0a0b28328","Type":"ContainerDied","Data":"26de9350c9e99ebacf8aab47effe860468a770add587c52043dcd6dc7c721bc7"}
Sep 15 21:46:19.126346 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.126308    2558 scope.go:117] "RemoveContainer" containerID="8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"
Sep 15 21:46:19.134427 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.134391    2558 scope.go:117] "RemoveContainer" containerID="cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"
Sep 15 21:46:19.141260 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.141243    2558 scope.go:117] "RemoveContainer" containerID="8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"
Sep 15 21:46:19.141555 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:46:19.141531    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445\": container with ID starting with 8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445 not found: ID does not exist" containerID="8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"
Sep 15 21:46:19.141646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.141563    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445"} err="failed to get container status \"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445\": rpc error: code = NotFound desc = could not find container \"8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445\": container with ID starting with 8a790d94d68f8cc8abdc900538173a169d3f25c3cb33dac00fb83f8cf1558445 not found: ID does not exist"
Sep 15 21:46:19.141646 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.141585    2558 scope.go:117] "RemoveContainer" containerID="cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"
Sep 15 21:46:19.142006 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:46:19.141965    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5\": container with ID starting with cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5 not found: ID does not exist" containerID="cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"
Sep 15 21:46:19.142110 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.142002    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5"} err="failed to get container status \"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5\": rpc error: code = NotFound desc = could not find container \"cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5\": container with ID starting with cb57a3bb91088254812dad92f9557d9685648f1e7b9218dd3290d3859fe892f5 not found: ID does not exist"
Sep 15 21:46:19.142757 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.142740    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:46:19.148548 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:19.148529    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f36399-openshift-default-7dc6fdd49b-mc7qv"]
Sep 15 21:46:20.960940 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:20.960904    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" path="/var/lib/kubelet/pods/fead5e95-5c0e-4761-8b52-9af0a0b28328/volumes"
Sep 15 21:46:24.095981 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.095923    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:46:24.096450 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.096257    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" podUID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" containerName="maas-api" containerID="cri-o://c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c" gracePeriod=30
Sep 15 21:46:24.125607 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.125579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.174824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.174788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:46:24.175046 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.175004    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" podUID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" containerName="payload-pre-processing" containerID="cri-o://128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c" gracePeriod=30
Sep 15 21:46:24.205275 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.205247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.310053 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.310021    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.407033 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.406985    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.410208 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.410189    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:46:24.441533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.441511    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:46:24.473634 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.473604    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.505464 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505442    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume\") pod \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") "
Sep 15 21:46:24.505585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") pod \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") "
Sep 15 21:46:24.505585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505513    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca\") pod \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") "
Sep 15 21:46:24.505672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505620    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs\") pod \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") "
Sep 15 21:46:24.505672 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505668    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l4t2\" (UniqueName: \"kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2\") pod \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\" (UID: \"d2993d25-4373-4c1b-aecf-fc44c9bdafc4\") "
Sep 15 21:46:24.505773 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505745    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk87q\" (UniqueName: \"kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q\") pod \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\" (UID: \"0984c6b6-17a3-46ca-b43c-04b7a075fdc7\") "
Sep 15 21:46:24.505829 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505794    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0984c6b6-17a3-46ca-b43c-04b7a075fdc7" (UID: "0984c6b6-17a3-46ca-b43c-04b7a075fdc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:24.505887 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505819    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2993d25-4373-4c1b-aecf-fc44c9bdafc4" (UID: "d2993d25-4373-4c1b-aecf-fc44c9bdafc4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:46:24.506006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.505986    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-plugins-config-volume\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.506006 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.506003    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.507577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.507554    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2993d25-4373-4c1b-aecf-fc44c9bdafc4" (UID: "d2993d25-4373-4c1b-aecf-fc44c9bdafc4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:46:24.507685 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.507667    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q" (OuterVolumeSpecName: "kube-api-access-xk87q") pod "0984c6b6-17a3-46ca-b43c-04b7a075fdc7" (UID: "0984c6b6-17a3-46ca-b43c-04b7a075fdc7"). InnerVolumeSpecName "kube-api-access-xk87q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:24.507729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.507705    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2" (OuterVolumeSpecName: "kube-api-access-9l4t2") pod "d2993d25-4373-4c1b-aecf-fc44c9bdafc4" (UID: "d2993d25-4373-4c1b-aecf-fc44c9bdafc4"). InnerVolumeSpecName "kube-api-access-9l4t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:46:24.507729 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.507709    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d2993d25-4373-4c1b-aecf-fc44c9bdafc4" (UID: "d2993d25-4373-4c1b-aecf-fc44c9bdafc4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:46:24.606718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.606684    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.606718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.606710    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.606718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.606719    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l4t2\" (UniqueName: \"kubernetes.io/projected/d2993d25-4373-4c1b-aecf-fc44c9bdafc4-kube-api-access-9l4t2\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.606718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.606728    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk87q\" (UniqueName: \"kubernetes.io/projected/0984c6b6-17a3-46ca-b43c-04b7a075fdc7-kube-api-access-xk87q\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:46:24.756068 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.756032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:24.856016 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:24.855982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:25.153342 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.153307    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" containerID="c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c" exitCode=0
Sep 15 21:46:25.153752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.153358    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"
Sep 15 21:46:25.153752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.153392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" event={"ID":"d2993d25-4373-4c1b-aecf-fc44c9bdafc4","Type":"ContainerDied","Data":"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"}
Sep 15 21:46:25.153752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.153446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb" event={"ID":"d2993d25-4373-4c1b-aecf-fc44c9bdafc4","Type":"ContainerDied","Data":"ee5fae1edd572501f9e08cef52c4ce0d95dac419781fcee384ac72b8873bd190"}
Sep 15 21:46:25.153752 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.153467    2558 scope.go:117] "RemoveContainer" containerID="c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"
Sep 15 21:46:25.154893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.154712    2558 generic.go:356] "Generic (PLEG): container finished" podID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" containerID="128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c" exitCode=0
Sep 15 21:46:25.154893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.154770    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"
Sep 15 21:46:25.154893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.154778    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" event={"ID":"0984c6b6-17a3-46ca-b43c-04b7a075fdc7","Type":"ContainerDied","Data":"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"}
Sep 15 21:46:25.154893 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.154812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6" event={"ID":"0984c6b6-17a3-46ca-b43c-04b7a075fdc7","Type":"ContainerDied","Data":"f1fbe0946aa98041309bcc06d4dd842a925c05393dad2d068ba2e1657c2e5614"}
Sep 15 21:46:25.161718 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.161703    2558 scope.go:117] "RemoveContainer" containerID="c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"
Sep 15 21:46:25.162007 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:46:25.161987    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c\": container with ID starting with c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c not found: ID does not exist" containerID="c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"
Sep 15 21:46:25.162104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.162031    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c"} err="failed to get container status \"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c\": rpc error: code = NotFound desc = could not find container \"c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c\": container with ID starting with c01ba4d15332c9b3ac82fed0668aa1cad5f586a17045ff1d681212028f80838c not found: ID does not exist"
Sep 15 21:46:25.162104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.162053    2558 scope.go:117] "RemoveContainer" containerID="128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"
Sep 15 21:46:25.168859 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.168828    2558 scope.go:117] "RemoveContainer" containerID="128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"
Sep 15 21:46:25.169134 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:46:25.169116    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c\": container with ID starting with 128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c not found: ID does not exist" containerID="128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"
Sep 15 21:46:25.169190 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.169141    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c"} err="failed to get container status \"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c\": rpc error: code = NotFound desc = could not find container \"128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c\": container with ID starting with 128ffd05b22cc486878a5a56bfdb82f3d6a5353117206b006c4cd4854d8f952c not found: ID does not exist"
Sep 15 21:46:25.171533 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.171513    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:46:25.175828 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.175809    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-745dff-5dff6f986-gdhg6"]
Sep 15 21:46:25.186675 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.186655    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:46:25.190988 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:25.190968    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-745dff-648f7b9555-r2jrb"]
Sep 15 21:46:26.700561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:26.700523    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:46:26.963167 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:26.963134    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" path="/var/lib/kubelet/pods/0984c6b6-17a3-46ca-b43c-04b7a075fdc7/volumes"
Sep 15 21:46:26.963660 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:26.963640    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" path="/var/lib/kubelet/pods/d2993d25-4373-4c1b-aecf-fc44c9bdafc4/volumes"
Sep 15 21:46:30.878236 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:30.878201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:30.933087 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:30.933023    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:31.212145 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:31.212116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:46:35.323423 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:46:35.323388    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:48:00.312232 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:00.312198    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:48:00.754361 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:00.754335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:48:02.308712 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:02.308667    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:48:26.308055 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:26.308023    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:48:34.096631 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:34.096601    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:48:41.405511 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:41.405477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:48:48.403279 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:48:48.403240    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:49:03.003520 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:49:03.003428    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:49:10.902925 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:49:10.902898    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:50:01.855083 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:01.855047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:50:37.800761 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:37.800677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:50:44.310136 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:44.310103    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:50:51.802356 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:51.802319    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:50:53.236184 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:53.236148    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:50:59.998142 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:50:59.998107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:51:00.803881 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:00.803848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:00.858099 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:00.858066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:07.421156 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:07.421117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:10.411282 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:10.411249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:51:48.698991 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:48.698940    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:50.407730 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:50.407687    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:51:50.708639 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:50.708610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:51:59.504320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:51:59.504249    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:03.982257 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:03.982225    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:06.497998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:06.497919    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:13.497834 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.497795    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:13.895772 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895697    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:13.895965 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895933    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" containerName="payload-processing"
Sep 15 21:52:13.895965 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895958    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" containerName="payload-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895970    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5841a94e-8478-4508-90db-5992dcaf3fae" containerName="payload-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895975    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5841a94e-8478-4508-90db-5992dcaf3fae" containerName="payload-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895981    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" containerName="maas-api"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895987    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" containerName="maas-api"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895994    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6babd8f-def1-4afb-8dca-b03b03e0691c" containerName="maas-api"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.895999    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6babd8f-def1-4afb-8dca-b03b03e0691c" containerName="maas-api"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896005    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896010    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896015    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896020    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896026    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896031    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" containerName="payload-pre-processing"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896042    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" containerName="maas-api"
Sep 15 21:52:13.896047 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896047    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" containerName="maas-api"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896055    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896060    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896067    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896072    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896115    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0bdffd2-c4fe-44b7-aa67-6d2b3a411f33" containerName="payload-pre-processing"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896122    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6babd8f-def1-4afb-8dca-b03b03e0691c" containerName="maas-api"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896127    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0984c6b6-17a3-46ca-b43c-04b7a075fdc7" containerName="payload-pre-processing"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896134    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896138    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2993d25-4373-4c1b-aecf-fc44c9bdafc4" containerName="maas-api"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896146    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2714d7-b5a3-46c9-b9b6-48c5bce0babb" containerName="payload-processing"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896152    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8aa5a3d-e8b9-46d7-8137-cfda7cc7e647" containerName="maas-api"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896157    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5841a94e-8478-4508-90db-5992dcaf3fae" containerName="payload-processing"
Sep 15 21:52:13.896514 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.896163    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="47bbbbe8-8f5a-40ab-87a2-9ee18ba304e5" containerName="payload-pre-processing"
Sep 15 21:52:13.898998 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.898981    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:13.902061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.902037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 21:52:13.902203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.902037    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4hmqz\""
Sep 15 21:52:13.902203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.902037    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 21:52:13.902203 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.902071    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 21:52:13.902366 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.902218    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 21:52:13.907818 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.907796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:13.910025 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.909993    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"]
Sep 15 21:52:13.910361 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.910346    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fead5e95-5c0e-4761-8b52-9af0a0b28328" containerName="istio-proxy"
Sep 15 21:52:13.913104 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.913085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:13.920935 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.920914    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"]
Sep 15 21:52:13.992380 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-metrics-certs\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:13.992502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:13.992502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv48r\" (UniqueName: \"kubernetes.io/projected/e73bd63e-9ba3-4123-8384-463d40e8003a-kube-api-access-xv48r\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:13.992502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:13.992502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzf82\" (UniqueName: \"kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:13.992502 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:13.992670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-maas-api-tls\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:13.992670 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:13.992559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e73bd63e-9ba3-4123-8384-463d40e8003a-openshift-service-ca\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.093114 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-metrics-certs\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.093168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.093168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv48r\" (UniqueName: \"kubernetes.io/projected/e73bd63e-9ba3-4123-8384-463d40e8003a-kube-api-access-xv48r\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.093168 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.093308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093180    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzf82\" (UniqueName: \"kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.093308 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.093405 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-maas-api-tls\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.093455 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e73bd63e-9ba3-4123-8384-463d40e8003a-openshift-service-ca\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.093896 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.093871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.094065 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.094048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e73bd63e-9ba3-4123-8384-463d40e8003a-openshift-service-ca\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.095694 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.095674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.095850 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.095834    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.095910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.095899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-maas-api-tls\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.096013 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.095995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e73bd63e-9ba3-4123-8384-463d40e8003a-metrics-certs\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.100154 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.100132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzf82\" (UniqueName: \"kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82\") pod \"maas-api-5c78f66949-brc5q\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") " pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.100367 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.100348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv48r\" (UniqueName: \"kubernetes.io/projected/e73bd63e-9ba3-4123-8384-463d40e8003a-kube-api-access-xv48r\") pod \"maas-api-775cbbbf65-njxv4\" (UID: \"e73bd63e-9ba3-4123-8384-463d40e8003a\") " pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.211044 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.211025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:14.223824 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.223808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:14.484558 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.484468    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:14.487366 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:52:14.487337    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod548a92a5_b299_4abb_91bd_a78dac63852a.slice/crio-4af643d62977a2a59a608b1d3f6261fe8c6bce4a3008d023d9106a488d5897ed WatchSource:0}: Error finding container 4af643d62977a2a59a608b1d3f6261fe8c6bce4a3008d023d9106a488d5897ed: Status 404 returned error can't find the container with id 4af643d62977a2a59a608b1d3f6261fe8c6bce4a3008d023d9106a488d5897ed
Sep 15 21:52:14.488507 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.488490    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 21:52:14.498882 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:14.498841    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"]
Sep 15 21:52:14.501070 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:52:14.501047    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73bd63e_9ba3_4123_8384_463d40e8003a.slice/crio-c99912f28cc9a2e66e5224061e5cb080679d6a0a5807b824db41965fb163aa21 WatchSource:0}: Error finding container c99912f28cc9a2e66e5224061e5cb080679d6a0a5807b824db41965fb163aa21: Status 404 returned error can't find the container with id c99912f28cc9a2e66e5224061e5cb080679d6a0a5807b824db41965fb163aa21
Sep 15 21:52:15.490986 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.490922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4" event={"ID":"e73bd63e-9ba3-4123-8384-463d40e8003a","Type":"ContainerStarted","Data":"8260b742910e9eb8e7aae0d1c2c133e8281a0c6b5d6ada89d727c0f71673071d"}
Sep 15 21:52:15.491177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.491006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4" event={"ID":"e73bd63e-9ba3-4123-8384-463d40e8003a","Type":"ContainerStarted","Data":"c99912f28cc9a2e66e5224061e5cb080679d6a0a5807b824db41965fb163aa21"}
Sep 15 21:52:15.491177 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.491033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:15.492376 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.492351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" event={"ID":"548a92a5-b299-4abb-91bd-a78dac63852a","Type":"ContainerStarted","Data":"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"}
Sep 15 21:52:15.492475 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.492392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" event={"ID":"548a92a5-b299-4abb-91bd-a78dac63852a","Type":"ContainerStarted","Data":"4af643d62977a2a59a608b1d3f6261fe8c6bce4a3008d023d9106a488d5897ed"}
Sep 15 21:52:15.492475 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.492415    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:15.507806 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.507761    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4" podStartSLOduration=2.137255659 podStartE2EDuration="2.507744316s" totalImagesPullingTime="370.488657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:15.506644971 +0000 UTC m=+2531.114342083" watchObservedRunningTime="2026-09-15 21:52:15.507744316 +0000 UTC m=+2531.115441404"
Sep 15 21:52:15.522175 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:15.522135    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" podStartSLOduration=2.113430514 podStartE2EDuration="2.522117889s" totalImagesPullingTime="408.687375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 21:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:52:15.520804813 +0000 UTC m=+2531.128501893" watchObservedRunningTime="2026-09-15 21:52:15.522117889 +0000 UTC m=+2531.129814977"
Sep 15 21:52:21.500927 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.500893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:21.501372 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.501348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-775cbbbf65-njxv4"
Sep 15 21:52:21.506796 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.506760    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:21.560819 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.560785    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:21.561014 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.560983    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" podUID="548a92a5-b299-4abb-91bd-a78dac63852a" containerName="maas-api" containerID="cri-o://8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279" gracePeriod=30
Sep 15 21:52:21.795359 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.795336    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:21.851244 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.851220    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca\") pod \"548a92a5-b299-4abb-91bd-a78dac63852a\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") "
Sep 15 21:52:21.851370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.851248    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzf82\" (UniqueName: \"kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82\") pod \"548a92a5-b299-4abb-91bd-a78dac63852a\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") "
Sep 15 21:52:21.851370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.851273    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls\") pod \"548a92a5-b299-4abb-91bd-a78dac63852a\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") "
Sep 15 21:52:21.851370 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.851304    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs\") pod \"548a92a5-b299-4abb-91bd-a78dac63852a\" (UID: \"548a92a5-b299-4abb-91bd-a78dac63852a\") "
Sep 15 21:52:21.851623 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.851599    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "548a92a5-b299-4abb-91bd-a78dac63852a" (UID: "548a92a5-b299-4abb-91bd-a78dac63852a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 21:52:21.853219 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.853196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "548a92a5-b299-4abb-91bd-a78dac63852a" (UID: "548a92a5-b299-4abb-91bd-a78dac63852a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:52:21.853320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.853276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82" (OuterVolumeSpecName: "kube-api-access-xzf82") pod "548a92a5-b299-4abb-91bd-a78dac63852a" (UID: "548a92a5-b299-4abb-91bd-a78dac63852a"). InnerVolumeSpecName "kube-api-access-xzf82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 21:52:21.853320 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.853297    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "548a92a5-b299-4abb-91bd-a78dac63852a" (UID: "548a92a5-b299-4abb-91bd-a78dac63852a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 21:52:21.952205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.952173    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/548a92a5-b299-4abb-91bd-a78dac63852a-openshift-service-ca\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:52:21.952205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.952204    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzf82\" (UniqueName: \"kubernetes.io/projected/548a92a5-b299-4abb-91bd-a78dac63852a-kube-api-access-xzf82\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:52:21.952205 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.952214    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-maas-api-tls\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:52:21.952363 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:21.952222    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/548a92a5-b299-4abb-91bd-a78dac63852a-metrics-certs\") on node \"ip-10-0-129-47.ec2.internal\" DevicePath \"\""
Sep 15 21:52:22.519352 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.519318    2558 generic.go:356] "Generic (PLEG): container finished" podID="548a92a5-b299-4abb-91bd-a78dac63852a" containerID="8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279" exitCode=0
Sep 15 21:52:22.519737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.519361    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"
Sep 15 21:52:22.519737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.519375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" event={"ID":"548a92a5-b299-4abb-91bd-a78dac63852a","Type":"ContainerDied","Data":"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"}
Sep 15 21:52:22.519737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.519424    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c78f66949-brc5q" event={"ID":"548a92a5-b299-4abb-91bd-a78dac63852a","Type":"ContainerDied","Data":"4af643d62977a2a59a608b1d3f6261fe8c6bce4a3008d023d9106a488d5897ed"}
Sep 15 21:52:22.519737 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.519453    2558 scope.go:117] "RemoveContainer" containerID="8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"
Sep 15 21:52:22.528268 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.528249    2558 scope.go:117] "RemoveContainer" containerID="8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"
Sep 15 21:52:22.528507 ip-10-0-129-47 kubenswrapper[2558]: E0915 21:52:22.528487    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279\": container with ID starting with 8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279 not found: ID does not exist" containerID="8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"
Sep 15 21:52:22.528585 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.528519    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279"} err="failed to get container status \"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279\": rpc error: code = NotFound desc = could not find container \"8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279\": container with ID starting with 8fed916dece00632cf98a499d0b050736b09bee5062e729712ab4f0a7efeb279 not found: ID does not exist"
Sep 15 21:52:22.540278 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.540257    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:22.543649 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.543621    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c78f66949-brc5q"]
Sep 15 21:52:22.961530 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:22.961501    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="548a92a5-b299-4abb-91bd-a78dac63852a" path="/var/lib/kubelet/pods/548a92a5-b299-4abb-91bd-a78dac63852a/volumes"
Sep 15 21:52:28.704179 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:28.704142    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:32.176592 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:32.176555    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:32.233364 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:32.233334    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:52:37.007891 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:37.007859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:41.804537 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:41.804499    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fn4gv"]
Sep 15 21:52:51.082240 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:51.082208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b4rbr_5992938c-72f2-4d79-a563-b617c5196bc3/server/0.log"
Sep 15 21:52:51.208186 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:51.208163    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hczd6_720a16e5-a08d-4145-9ba7-1248a436dd02/manager/0.log"
Sep 15 21:52:51.471574 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:51.471554    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b8bf8c4-c29rb_7a0b3878-dc1b-4dbf-808b-67e904d350ef/copy-manifests/0.log"
Sep 15 21:52:51.478262 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:51.478244    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b8bf8c4-c29rb_7a0b3878-dc1b-4dbf-808b-67e904d350ef/manager/0.log"
Sep 15 21:52:51.971187 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:51.971159    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-775cbbbf65-njxv4_e73bd63e-9ba3-4123-8384-463d40e8003a/maas-api/0.log"
Sep 15 21:52:53.845576 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:53.845522    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fn4gv_7a8b4fda-cd0d-4613-bbd1-faa982f907ef/limitador/0.log"
Sep 15 21:52:54.460420 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:54.460391    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tn5gc_3b42a3e0-cb80-4dbb-bf0c-888855ad70be/discovery/0.log"
Sep 15 21:52:56.022061 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:52:56.022028    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmnc5s_9a8d2b31-376f-40f3-81b1-e76007081eef/main/0.log"
Sep 15 21:53:02.458909 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:02.458857    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:53:03.762116 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:03.762078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log" limit=1024
Sep 15 21:53:05.312561 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:05.312529    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dtvm5_5df86f76-b4bc-496a-a33c-26433949cb80/global-pull-secret-syncer/0.log"
Sep 15 21:53:05.397910 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:05.397822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5tp9j_aafd90f8-c441-4398-bd0a-adc44222e828/konnectivity-agent/0.log"
Sep 15 21:53:05.486131 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:05.486097    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-47.ec2.internal_a1d1f32183c689b14f278b7c0504a490/haproxy/0.log"
Sep 15 21:53:10.446891 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:10.446857    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fn4gv_7a8b4fda-cd0d-4613-bbd1-faa982f907ef/limitador/0.log"
Sep 15 21:53:12.512754 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:12.512722    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vzrrk_0a695a19-e45a-405f-bd35-87bd9d8ca770/node-exporter/0.log"
Sep 15 21:53:12.537813 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:12.537763    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vzrrk_0a695a19-e45a-405f-bd35-87bd9d8ca770/kube-rbac-proxy/0.log"
Sep 15 21:53:12.561518 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:12.561492    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vzrrk_0a695a19-e45a-405f-bd35-87bd9d8ca770/init-textfile/0.log"
Sep 15 21:53:15.380034 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.380003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"]
Sep 15 21:53:15.380390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.380260    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="548a92a5-b299-4abb-91bd-a78dac63852a" containerName="maas-api"
Sep 15 21:53:15.380390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.380271    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="548a92a5-b299-4abb-91bd-a78dac63852a" containerName="maas-api"
Sep 15 21:53:15.380390 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.380320    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="548a92a5-b299-4abb-91bd-a78dac63852a" containerName="maas-api"
Sep 15 21:53:15.383073 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.383050    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.385140 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.385117    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljsqz\"/\"default-dockercfg-gfrqc\""
Sep 15 21:53:15.385140 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.385139    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsqz\"/\"kube-root-ca.crt\""
Sep 15 21:53:15.385328 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.385273    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsqz\"/\"openshift-service-ca.crt\""
Sep 15 21:53:15.391793 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.391770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"]
Sep 15 21:53:15.454470 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.454442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-proc\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.454596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.454485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5q6d\" (UniqueName: \"kubernetes.io/projected/b095413f-90c7-4223-89e1-ed1dd3f07cc4-kube-api-access-f5q6d\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.454596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.454540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-sys\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.454596 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.454562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-lib-modules\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.454726 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.454618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-podres\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555526 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-podres\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-proc\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5q6d\" (UniqueName: \"kubernetes.io/projected/b095413f-90c7-4223-89e1-ed1dd3f07cc4-kube-api-access-f5q6d\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555591    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-sys\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555626 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-lib-modules\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-proc\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-podres\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555662    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-sys\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.555780 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.555723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b095413f-90c7-4223-89e1-ed1dd3f07cc4-lib-modules\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.562732 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.562715    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5q6d\" (UniqueName: \"kubernetes.io/projected/b095413f-90c7-4223-89e1-ed1dd3f07cc4-kube-api-access-f5q6d\") pod \"perf-node-gather-daemonset-flxqv\" (UID: \"b095413f-90c7-4223-89e1-ed1dd3f07cc4\") " pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.694106 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.694056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:15.959666 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:15.959640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"]
Sep 15 21:53:15.962440 ip-10-0-129-47 kubenswrapper[2558]: W0915 21:53:15.962411    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb095413f_90c7_4223_89e1_ed1dd3f07cc4.slice/crio-29ba8cc32039b70a4ea3236baa59569f27f21b437f3784b319436069ef27cb99 WatchSource:0}: Error finding container 29ba8cc32039b70a4ea3236baa59569f27f21b437f3784b319436069ef27cb99: Status 404 returned error can't find the container with id 29ba8cc32039b70a4ea3236baa59569f27f21b437f3784b319436069ef27cb99
Sep 15 21:53:16.727018 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:16.726985    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv" event={"ID":"b095413f-90c7-4223-89e1-ed1dd3f07cc4","Type":"ContainerStarted","Data":"6d8c467c99a74440abfba3fd8418a34726db93912ff55f31afcccab83a911566"}
Sep 15 21:53:16.727378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:16.727039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv" event={"ID":"b095413f-90c7-4223-89e1-ed1dd3f07cc4","Type":"ContainerStarted","Data":"29ba8cc32039b70a4ea3236baa59569f27f21b437f3784b319436069ef27cb99"}
Sep 15 21:53:16.727378 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:16.727066    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:16.743108 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:16.743062    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv" podStartSLOduration=1.7430451040000001 podStartE2EDuration="1.743045104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 21:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 21:53:16.742453313 +0000 UTC m=+2592.350150401" watchObservedRunningTime="2026-09-15 21:53:16.743045104 +0000 UTC m=+2592.350742173"
Sep 15 21:53:17.586901 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:17.586864    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbb4h_7dfa7d65-d90e-481a-bc89-434ae5fc0bad/dns/0.log"
Sep 15 21:53:17.614936 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:17.614912    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vbb4h_7dfa7d65-d90e-481a-bc89-434ae5fc0bad/kube-rbac-proxy/0.log"
Sep 15 21:53:17.696369 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:17.696344    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d9d6m_0109072d-3dde-4376-9f9f-0c8ef1a97e77/dns-node-resolver/0.log"
Sep 15 21:53:18.412033 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:18.412008    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qjpnf_15611823-4696-46c5-8246-c704b187a69f/node-ca/0.log"
Sep 15 21:53:20.174778 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:20.174744    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tn5gc_3b42a3e0-cb80-4dbb-bf0c-888855ad70be/discovery/0.log"
Sep 15 21:53:21.288335 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:21.288306    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jxjxt_c439c286-dc5b-4cca-b7ef-f89e9a30c53b/serve-healthcheck-canary/0.log"
Sep 15 21:53:21.777892 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:21.777864    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-479w8_d87e4d64-3f46-4276-8d7d-9e01584a93e2/kube-rbac-proxy/0.log"
Sep 15 21:53:21.799784 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:21.799758    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-479w8_d87e4d64-3f46-4276-8d7d-9e01584a93e2/exporter/0.log"
Sep 15 21:53:21.823012 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:21.822987    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-479w8_d87e4d64-3f46-4276-8d7d-9e01584a93e2/extractor/0.log"
Sep 15 21:53:22.739957 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:22.739919    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ljsqz/perf-node-gather-daemonset-flxqv"
Sep 15 21:53:24.798575 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:24.798521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-b4rbr_5992938c-72f2-4d79-a563-b617c5196bc3/server/0.log"
Sep 15 21:53:24.931479 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:24.931452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hczd6_720a16e5-a08d-4145-9ba7-1248a436dd02/manager/0.log"
Sep 15 21:53:25.074625 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:25.074554    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b8bf8c4-c29rb_7a0b3878-dc1b-4dbf-808b-67e904d350ef/manager/0.log"
Sep 15 21:53:25.099874 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:25.099852    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-568b8bf8c4-c29rb_7a0b3878-dc1b-4dbf-808b-67e904d350ef/copy-manifests/0.log"
Sep 15 21:53:25.857988 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:25.857934    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tn5gc_3b42a3e0-cb80-4dbb-bf0c-888855ad70be/discovery/0.log"
Sep 15 21:53:26.466886 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:26.466859    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-ffdbb6cbd-skmt7_1009d764-c541-4fa3-b3e0-db9e59595f79/manager/0.log"
Sep 15 21:53:28.318577 ip-10-0-129-47 kubenswrapper[2558]: I0915 21:53:28.318531    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-tn5gc_3b42a3e0-cb80-4dbb-bf0c-888855ad70be/discovery/0.log"